Jul 01 06:35:30 devstack cinder-volume[75001]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 01 06:35:30 devstack cinder-volume[75001]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 06:35:30 devstack cinder-volume[75001]: we strongly recommend against using it for new projects. Jul 01 06:35:30 devstack cinder-volume[75001]: If you are already using Eventlet, we recommend migrating to a different Jul 01 06:35:30 devstack cinder-volume[75001]: framework. For more detail see Jul 01 06:35:30 devstack cinder-volume[75001]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 06:35:30 devstack cinder-volume[75001]: import eventlet # noqa Jul 01 06:35:33 devstack cinder-volume[75001]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:35:33 devstack cinder-volume[75001]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:35:33 devstack cinder-volume[75001]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:35:33 devstack cinder-volume[75001]: INFO dbcounter [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Registered counter for database cinder Jul 01 06:35:33 devstack cinder-volume[75001]: DEBUG oslo_db.sqlalchemy.engines [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG dbcounter [-] [75001] Writer thread running {{(pid=75001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 06:35:34 devstack cinder-volume[75001]: INFO cinder.rpc [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 01 06:35:34 devstack cinder-volume[75001]: INFO cinder.rpc [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG oslo_db.sqlalchemy.engines [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:35:34 devstack cinder-volume[75001]: INFO cinder.volume.manager [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Determined volume DB was empty at startup. Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG cinder.volume.manager [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75001) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 01 06:35:34 devstack cinder-volume[75001]: INFO cinder.volume.manager [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 01 06:35:34 devstack cinder-volume[75001]: WARNING stevedore.named [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 06:35:34 devstack cinder-volume[75001]: WARNING castellan.key_manager [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:35:34 devstack cinder-volume[75001]: WARNING cinder.keymgr.conf_key_mgr [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG cinder.volume.drivers.lvm [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75001) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG oslo_concurrency.processutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75001) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG oslo_concurrency.processutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] CMD "cinder-rtstool verify" returned: 0 in 0.427s {{(pid=75001) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:34 devstack cinder-volume[75001]: DEBUG oslo_db.sqlalchemy.engines [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:35:34 devstack cinder-volume[75001]: INFO cinder.rpc [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 01 06:35:35 devstack cinder-volume[75001]: INFO cinder.rpc [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 01 06:35:35 devstack cinder-volume[75001]: WARNING stevedore.named [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 06:35:35 devstack cinder-volume[75001]: WARNING castellan.key_manager [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:35:35 devstack cinder-volume[75001]: INFO cinder.volume.manager [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_db.sqlalchemy.engines [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:35:35 devstack cinder-volume[75001]: INFO oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Starting 1 workers Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Started child 75176 {{(pid=75001) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Full set of CONF: {{(pid=75001) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] ******************************************************************************** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Configuration options gathered from: {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] ================================================================================ {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] allow_availability_zone_fallback = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] allow_compression_on_image_upload = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] allowed_direct_url_schemes = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] api_rate_limit = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] auth_strategy = keystone {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] az_cache_duration = 3600 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_availability_zone = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75176]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_host = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_stats_polling_interval = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backup_api_class = cinder.backup.api.API {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backup_name_template = backup-%s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backup_use_same_host = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backup_use_temp_snapshot = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] chap_password = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] chap_username = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_internal_tenant_project_id = b432b94041f446e5b4c0458c5abfb2d4 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_internal_tenant_user_id = 25b5019362ac46ab91876e1214f01661 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cloned_volume_same_az = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cluster = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] compression_format = gzip {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] compute_api_class = cinder.compute.nova.API {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] config_dir = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] config_source = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] control_exchange = openstack {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] debug = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] default_availability_zone = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] default_group_type = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] default_volume_type = lvmdriver-1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] disk_geometry = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] driver_client_cert = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] driver_client_cert_key = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] driver_data_namespace = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] driver_ssl_cert_path = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] driver_ssl_cert_verify = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] driver_use_ssl = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] enable_force_upload = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] enable_new_services = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] enable_unsupported_driver = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] enabled_backends = ['lvmdriver-1'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] enforce_multipath_for_image_xfer = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] filter_function = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_api_insecure = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_api_ssl_compression = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_ca_certificates_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_catalog_info = image:glance:publicURL {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_num_retries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance_request_timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] goodness_function = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] graceful_shutdown_timeout = 5 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] group_api_class = cinder.group.api.API {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] host = devstack {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_compress_on_upload = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_conversion_address_space_limit = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_conversion_cpu_limit = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_conversion_disable = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_upload_use_cinder_backend = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 01 06:35:35 devstack sudo[75180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_upload_use_internal_tenant = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_volume_cache_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack sudo[75180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_volume_cache_max_count = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] image_volume_cache_max_size_gb = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] init_host_max_objects_retrieval = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] instance_format = [instance: %(uuid)s] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] iscsi_target_flags = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] iscsi_write_cache = on {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] iser_helper = tgtadm {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] iser_ip_address = 192.168.122.68 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] iser_port = 3260 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_color = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_config_append = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_dir = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_options = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_rotate_interval = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_rotate_interval_type = days {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] log_rotation_type = none {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] max_age = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] max_logfile_count = 30 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] max_logfile_size_mb = 200 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] max_over_subscription_ratio = 20.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] message_reap_interval = 86400 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] message_ttl = 2592000 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] migration_create_volume_timeout_secs = 300 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] monkey_patch = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] monkey_patch_modules = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] my_ip = 192.168.122.68 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] no_snapshot_gb_quota = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] num_iser_scan_tries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] num_shell_tries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] num_volume_device_scan_tries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] nvmeof_conn_info_version = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] nvmet_ns_id = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] nvmet_port_id = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_max_limit = 1000 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_volume_ext_list = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_volume_listen = 0.0.0.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_volume_listen_port = 8776 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_volume_use_ssl = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] osapi_volume_workers = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] per_volume_size_limit = -1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] periodic_fuzzy_delay = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] periodic_interval = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] project_id_regex = [0-9a-f\-]+ {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] public_endpoint = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] publish_errors = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_backup_gigabytes = 1000 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_backups = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_gigabytes = 1000 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_groups = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_snapshots = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] quota_volumes = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] rate_limit_burst = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] rate_limit_except_level = CRITICAL {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] rate_limit_interval = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] reinit_driver_count = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] replication_device = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] report_discard_supported = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] report_interval = 120 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] reservation_clean_interval = 86400 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] reservation_expire = 86400 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] reserved_image_namespaces = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] reserved_percentage = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] rpc_response_timeout = 120 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] run_external_periodic_tasks = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] scst_target_driver = iscsi {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] scst_target_iqn_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_down_time = 720 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] shell_completion = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] snapshot_name_template = snapshot-%s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] snapshot_same_host = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] split_loggers = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] state_path = /opt/stack/data/cinder {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] storage_availability_zone = nova {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] storage_protocol = iSCSI {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] syslog_log_facility = LOG_USER {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] target_helper = lioadm {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] target_ip_address = 192.168.122.68 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] target_port = 3260 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] target_protocol = iscsi {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] target_secondary_ip_addresses = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] trace_flags = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] transfer_api_class = cinder.transfer.api.API {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] transport_url = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] until_refresh = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_chap_auth = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_default_quota_class = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_journal = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_json = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_multipath_for_image_xfer = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_stderr = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] use_syslog = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] verify_glance_signatures = enabled {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_api_class = cinder.volume.api.API {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_backend_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_clear = zero {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_clear_ionice = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_clear_size = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_copy_bps_limit = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_dd_blocksize = 1M {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_name_template = volume-%s {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_service_inithost_offload = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volume_usage_audit_period = month {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] zoning_mode = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_concurrency.disable_process_locking = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.auth_section = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.auth_type = password {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.auth_version = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.cache = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.delay_auth_decision = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.http_connect_timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.include_service_catalog = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.insecure = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.interface = public {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_password = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcache_username = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.region_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.service_token_roles_required = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.service_type = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.token_cache_time = 300 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.backend = dogpile.cache.null {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.backend_argument = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.backend_expiration_time = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.config_prefix = cache.oslo {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.debug_cache_backend = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.enable_retry_client = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.enable_socket_keepalive = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.expiration_time = 600 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.hashclient_retry_attempts = 2 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_dead_retry = 300 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_pool_maxsize = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_sasl_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.password = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.proxies = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.redis_db = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.redis_sentinel_service_name = mymaster {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.redis_server = localhost:6379 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.retry_attempts = 2 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.retry_delay = 0.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.socket_keepalive_count = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.socket_keepalive_idle = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.socket_keepalive_interval = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.socket_timeout = 1.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.tls_allowed_ciphers = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.tls_cafile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.tls_certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.tls_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.tls_keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cache.username = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] coordination.backend_url = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.asyncio_connection = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.asyncio_slave_connection = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.backend = sqlalchemy {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.connection = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.connection_debug = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.connection_parameters = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.connection_recycle_time = 3600 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.connection_trace = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.db_inc_retry_interval = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.db_max_retries = 20 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.db_max_retry_interval = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.db_retry_interval = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.max_overflow = 50 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.max_pool_size = 5 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.max_retries = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.mysql_wsrep_sync_wait = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.pool_timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.retry_interval = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.slave_connection = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.sqlite_synchronous = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.synchronous_reader = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] database.use_db_reconnect = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.connection_string = messaging:// {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.es_doc_type = notification {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.es_scroll_size = 10000 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.es_scroll_time = 2m {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.filter_error_trace = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.hmac_keys = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.sentinel_service_name = mymaster {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.socket_timeout = 0.1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.trace_requests = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler.trace_sqlalchemy = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler_jaeger.process_tags = {} {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler_jaeger.service_name_prefix = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] profiler_otlp.service_name_prefix = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.enforce_new_defaults = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.enforce_scope = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.policy_default_rule = default {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.policy_file = policy.yaml {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_policy.remote_timeout = 60.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.group = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.helper_command = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] privsep_osbrick.user = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.group = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.helper_command = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] cinder_sys_admin.user = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.auth_section = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.auth_type = password {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.cafile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.collect_timing = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.insecure = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.send_service_user_token = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.split_loggers = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] service_user.timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.auth_section = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.auth_type = password {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.collect_timing = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.insecure = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.region_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.split_loggers = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] glance.timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.backend_availability_zone = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.chap_password = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.chap_username = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.disk_geometry = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.driver_client_cert = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.driver_client_cert_key = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.driver_data_namespace = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.driver_use_ssl = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.enable_unsupported_driver = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.extra_capabilities = {} {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.filter_function = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.goodness_function = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.iscsi_target_flags = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.iscsi_write_cache = on {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.iser_helper = tgtadm {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.iser_port = 3260 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.lvm_mirrors = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.lvm_share_target = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.lvm_type = auto {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.num_shell_tries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.nvmet_port_id = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.replication_device = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.report_discard_supported = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.reserved_percentage = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.scst_target_driver = iscsi {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.scst_target_iqn_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.storage_protocol = iSCSI {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.target_helper = tgtadm {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.target_port = 3260 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.target_protocol = iscsi {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.trace_flags = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.unique_fqdn_network = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.use_chap_auth = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_backend_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_clear = zero {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_clear_ionice = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_clear_size = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volume_group = cinder-volumes {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_reports.file_event_handler = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_reports.log_dir = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.backend_availability_zone = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.backend_host = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.chap_password = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.chap_username = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.chiscsi_conf = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.disk_geometry = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.driver_client_cert = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.driver_data_namespace = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.driver_use_ssl = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.extra_capabilities = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.filter_function = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.goodness_function = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.iser_helper = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.iser_ip_address = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.iser_port = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.iser_target_prefix = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.lvm_conf_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.lvm_mirrors = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.lvm_share_target = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.lvm_type = auto {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.num_shell_tries = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.nvmet_port_id = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.replication_device = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.report_discard_supported = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.reserved_percentage = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.scst_target_driver = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.storage_protocol = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.target_helper = lioadm {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.target_ip_address = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.target_port = 3260 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.target_protocol = iscsi {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.trace_flags = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.use_chap_auth = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_clear = zero {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_clear_size = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] lvmdriver-1.volumes_dir = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.ssl_version = {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_notifications.driver = [] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_notifications.retry = -1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] oslo_messaging_notifications.transport_url = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] key_manager.fixed_key = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.barbican_api_version = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.barbican_endpoint = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.barbican_endpoint_type = public {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.barbican_region_name = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.cafile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.collect_timing = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.insecure = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.number_of_retries = 60 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.retry_delay = 1 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.send_service_user_token = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.split_loggers = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.verify_ssl = True {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican.verify_ssl_path = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.auth_section = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.auth_type = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.cafile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.certfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.collect_timing = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.insecure = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.keyfile = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.split_loggers = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] barbican_service_user.timeout = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.approle_role_id = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.approle_secret_id = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.kv_mountpoint = secret {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.kv_path = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.kv_version = 2 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.namespace = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.root_token_id = **** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.ssl_ca_crt_file = None {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.timeout = 60.0 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.use_ssl = False {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:35:35 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] ******************************************************************************** {{(pid=75001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 01 06:35:36 devstack sudo[75180]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.873s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:36 devstack sudo[75262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:36 devstack sudo[75262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:36 devstack sudo[75262]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.646s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:35:36 devstack cinder-volume[75176]: INFO cinder.brick.local_dev.lvm [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:36 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:36 devstack sudo[75481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:35:36 devstack sudo[75481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:37 devstack sudo[75481]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:37 devstack cinder-volume[75176]: DEBUG cinder.brick.local_dev.lvm [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75176) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 01 06:35:37 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:37 devstack sudo[75672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:37 devstack sudo[75672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:38 devstack sudo[75672]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.386s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:38 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:38 devstack sudo[75916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:38 devstack sudo[75916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:39 devstack sudo[75916]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:39 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:39 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:39 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:39 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:39 devstack sudo[75962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 01 06:35:39 devstack sudo[75962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:40 devstack sudo[75962]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:40 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.716s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:40 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:40 devstack sudo[75966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:35:40 devstack sudo[75966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:41 devstack sudo[75966]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:41 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.921s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:41 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:41 devstack sudo[75984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:35:41 devstack sudo[75984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:42 devstack sudo[75984]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:42 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.871s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:42 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:42 devstack sudo[75990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:42 devstack sudo[75990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:43 devstack sudo[75990]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.868s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:43 devstack sudo[75995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:43 devstack sudo[75995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:43 devstack sudo[75995]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:43 devstack sudo[76003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:43 devstack sudo[76003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:44 devstack sudo[76003]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:44 devstack cinder-volume[75176]: INFO cinder.volume.drivers.lvm [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 01 06:35:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:44 devstack sudo[76017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:44 devstack sudo[76017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:45 devstack cinder-volume[75001]: DEBUG dbcounter [-] [75001] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:35:45 devstack sudo[76017]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.826s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:45 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:35:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:45 devstack sudo[76131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:35:45 devstack sudo[76131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:45 devstack sudo[76131]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:46 devstack sudo[76271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:46 devstack sudo[76271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:46 devstack sudo[76271]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:46 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:46 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:46 devstack sudo[76274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:46 devstack sudo[76274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:47 devstack sudo[76274]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:47 devstack sudo[76277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:47 devstack sudo[76277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:47 devstack sudo[76277]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:47 devstack cinder-volume[75176]: INFO cinder.volume.driver [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Driver hasn't implemented _init_vendor_properties() Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG cinder.volume.driver [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75176) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG oslo_db.sqlalchemy.engines [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writer thread running {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 06:35:47 devstack cinder-volume[75176]: DEBUG cinder.db.api [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Building query based on filter {{(pid=75176) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 01 06:35:48 devstack cinder-volume[75176]: DEBUG cinder.image.image_utils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75176) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 01 06:35:48 devstack cinder-volume[75176]: INFO cinder.keymgr.migration [None req-b511b569-88c2-422a-990c-66833341a5ec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 01 06:35:48 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:35:48 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:48 devstack sudo[76285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:35:48 devstack sudo[76285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:48 devstack sudo[76285]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:48 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:48 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:48 devstack sudo[76289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:48 devstack sudo[76289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:49 devstack sudo[76289]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:49 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:49 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:49 devstack sudo[76292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:49 devstack sudo[76292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:50 devstack sudo[76292]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:50 devstack sudo[76296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:50 devstack sudo[76296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:50 devstack sudo[76296]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:35:50 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Driver initialization completed successfully. Jul 01 06:35:50 devstack cinder-volume[75176]: INFO cinder.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Initiating service 2 cleanup Jul 01 06:35:50 devstack cinder-volume[75176]: INFO cinder.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Service 2 cleanup completed. Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG cinder.service [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Creating RPC server for service cinder-volume {{(pid=75176) start /opt/stack/cinder/cinder/service.py:231}} Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG cinder.service [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75176) start /opt/stack/cinder/cinder/service.py:237}} Jul 01 06:35:50 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:35:50 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:50 devstack sudo[76299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:35:50 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:51 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:51 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:51 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:51 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:51 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:52 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:52 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:52 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:52 devstack sudo[76309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:35:52 devstack sudo[76309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:52 devstack sudo[76309]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:52 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:52 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:35:52 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:35:52 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:35:53 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Jul 01 06:35:53 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:35:53 devstack cinder-volume[75176]: INFO cinder.volume.manager [None req-1fa1e8f6-29b2-4240-b77c-8c705ddd105a None None] Driver post RPC initialization completed successfully. Jul 01 06:36:03 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=3 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:36:03 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:36:43 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:36:43 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:36:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:36:43 devstack sudo[78021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:36:43 devstack sudo[78021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:36:44 devstack sudo[78021]: pam_unix(sudo:session): session closed for user root Jul 01 06:36:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:36:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:36:44 devstack sudo[78024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:36:44 devstack sudo[78024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:36:44 devstack sudo[78024]: pam_unix(sudo:session): session closed for user root Jul 01 06:36:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:36:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:36:44 devstack sudo[78060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:36:44 devstack sudo[78060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:36:45 devstack sudo[78060]: pam_unix(sudo:session): session closed for user root Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:36:45 devstack sudo[78063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:36:45 devstack sudo[78063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:36:45 devstack sudo[78063]: pam_unix(sudo:session): session closed for user root Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running periodic task VolumeManager._thread_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] thread count: 6 {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:36:45 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] thread info: [<_MainThread(MainThread, started 138448964436096)>, , , , , ] {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:37:43 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:37:43 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:37:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:37:43 devstack sudo[81282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:37:43 devstack sudo[81282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:37:44 devstack sudo[81282]: pam_unix(sudo:session): session closed for user root Jul 01 06:37:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:37:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:37:44 devstack sudo[81286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:37:44 devstack sudo[81286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:37:44 devstack sudo[81286]: pam_unix(sudo:session): session closed for user root Jul 01 06:37:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:37:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:37:44 devstack sudo[81295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:37:44 devstack sudo[81295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:37:45 devstack sudo[81295]: pam_unix(sudo:session): session closed for user root Jul 01 06:37:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:37:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:37:45 devstack sudo[81306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:37:45 devstack sudo[81306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:37:45 devstack sudo[81306]: pam_unix(sudo:session): session closed for user root Jul 01 06:37:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:37:45 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:38:03 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:38:03 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:UPDATE=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:38:43 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:38:43 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:38:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:38:43 devstack sudo[83206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:38:43 devstack sudo[83206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:38:44 devstack sudo[83206]: pam_unix(sudo:session): session closed for user root Jul 01 06:38:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:38:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:38:44 devstack sudo[83232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:38:44 devstack sudo[83232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:38:44 devstack sudo[83232]: pam_unix(sudo:session): session closed for user root Jul 01 06:38:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:38:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:38:44 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:38:44 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:38:45 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Jul 01 06:38:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:38:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:38:45 devstack sudo[83289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:38:45 devstack sudo[83289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:38:46 devstack sudo[83289]: pam_unix(sudo:session): session closed for user root Jul 01 06:38:46 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:38:46 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:38:46 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running periodic task VolumeManager._thread_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:38:46 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] thread count: 6 {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:38:46 devstack cinder-volume[75176]: DEBUG cinder.volume.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] thread info: [<_MainThread(MainThread, started 138448964436096)>, , , , , ] {{(pid=75176) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:39:43 devstack cinder-volume[75176]: DEBUG oslo_service.periodic_task [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:39:43 devstack cinder-volume[75176]: DEBUG cinder.volume.drivers.lvm [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Updating volume stats {{(pid=75176) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 06:39:43 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:39:43 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 06:39:43 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:39:44 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Jul 01 06:39:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:39:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:39:44 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:39:44 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:39:44 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Jul 01 06:39:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:39:44 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:39:44 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 06:39:44 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:39:45 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Jul 01 06:39:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:39:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:39:45 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 06:39:45 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:39:45 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Jul 01 06:39:45 devstack cinder-volume[75176]: DEBUG oslo_concurrency.processutils [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:39:45 devstack cinder-volume[75176]: DEBUG cinder.manager [None req-d07a3a3a-71e7-46d7-8452-d32b0136378b None None] Notifying Schedulers of capabilities ... {{(pid=75176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:40:03 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:SELECT=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:40:03 devstack cinder-volume[75176]: DEBUG dbcounter [-] [75176] Writing DB stats cinder:UPDATE=1 {{(pid=75176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:40:09 devstack cinder-volume[75001]: INFO oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Caught SIGTERM, stopping children Jul 01 06:40:09 devstack cinder-volume[75001]: DEBUG oslo_concurrency.lockutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Acquiring lock "singleton_lock" {{(pid=75001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:40:09 devstack cinder-volume[75001]: DEBUG oslo_concurrency.lockutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Acquired lock "singleton_lock" {{(pid=75001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:40:09 devstack cinder-volume[75001]: DEBUG oslo_concurrency.lockutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Releasing lock "singleton_lock" {{(pid=75001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:40:09 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Stop services. {{(pid=75001) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 01 06:40:09 devstack cinder-volume[75001]: DEBUG oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Killing children. {{(pid=75001) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 01 06:40:09 devstack cinder-volume[75001]: INFO oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Waiting on 1 children to exit Jul 01 06:40:10 devstack cinder-volume[75176]: DEBUG oslo_concurrency.lockutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Acquiring lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:40:10 devstack cinder-volume[75176]: DEBUG oslo_concurrency.lockutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Acquired lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:40:10 devstack cinder-volume[75176]: DEBUG oslo_concurrency.lockutils [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Releasing lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:40:10 devstack cinder-volume[75176]: WARNING amqp [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 06:40:10 devstack cinder-volume[75176]: WARNING amqp [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 06:40:10 devstack cinder-volume[75001]: INFO oslo_service.backend._eventlet.service [None req-292f34b2-9215-4997-adaf-84c8d48233fb None None] Child 75176 exited with status 0 Jul 01 06:40:11 devstack cinder-volume[85225]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 01 06:40:11 devstack cinder-volume[85225]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 06:40:11 devstack cinder-volume[85225]: we strongly recommend against using it for new projects. Jul 01 06:40:11 devstack cinder-volume[85225]: If you are already using Eventlet, we recommend migrating to a different Jul 01 06:40:11 devstack cinder-volume[85225]: framework. For more detail see Jul 01 06:40:11 devstack cinder-volume[85225]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 06:40:11 devstack cinder-volume[85225]: import eventlet # noqa Jul 01 06:40:13 devstack cinder-volume[85225]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:40:13 devstack cinder-volume[85225]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:40:13 devstack cinder-volume[85225]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:40:13 devstack cinder-volume[85225]: INFO dbcounter [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Registered counter for database cinder Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_db.sqlalchemy.engines [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG dbcounter [-] [85225] Writer thread running {{(pid=85225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 06:40:14 devstack cinder-volume[85225]: INFO cinder.rpc [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 01 06:40:14 devstack cinder-volume[85225]: INFO cinder.rpc [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_db.sqlalchemy.engines [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:14 devstack cinder-volume[85225]: INFO cinder.volume.manager [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Determined volume DB was empty at startup. Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG cinder.volume.manager [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85225) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 01 06:40:14 devstack cinder-volume[85225]: INFO cinder.volume.manager [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 01 06:40:14 devstack cinder-volume[85225]: WARNING stevedore.named [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 06:40:14 devstack cinder-volume[85225]: WARNING castellan.key_manager [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:40:14 devstack cinder-volume[85225]: WARNING cinder.keymgr.conf_key_mgr [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:40:14 devstack cinder-volume[85225]: INFO cinder.volume.manager [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_db.sqlalchemy.engines [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:14 devstack cinder-volume[85225]: INFO oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Starting 1 workers Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Started child 85443 {{(pid=85225) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Full set of CONF: {{(pid=85225) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] ******************************************************************************** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Configuration options gathered from: {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] ================================================================================ {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] allow_availability_zone_fallback = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] allow_compression_on_image_upload = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] allowed_direct_url_schemes = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] api_rate_limit = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] auth_strategy = keystone {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_availability_zone = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_host = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_stats_polling_interval = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85443]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backup_api_class = cinder.backup.api.API {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backup_name_template = backup-%s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backup_use_same_host = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backup_use_temp_snapshot = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] chap_password = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] chap_username = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_internal_tenant_project_id = b432b94041f446e5b4c0458c5abfb2d4 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_internal_tenant_user_id = 25b5019362ac46ab91876e1214f01661 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cluster = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] compression_format = gzip {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] compute_api_class = cinder.compute.nova.API {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] config_dir = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] config_source = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] control_exchange = openstack {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] debug = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] default_availability_zone = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] default_group_type = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] default_volume_type = QuobyteHD {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] disk_geometry = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] driver_client_cert = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] driver_client_cert_key = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] driver_data_namespace = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] driver_ssl_cert_path = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] driver_ssl_cert_verify = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] driver_use_ssl = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] enable_new_services = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] enable_unsupported_driver = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] enabled_backends = ['QuobyteHD'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] enforce_multipath_for_image_xfer = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] filter_function = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_api_insecure = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_api_ssl_compression = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_ca_certificates_file = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_catalog_info = image:glance:publicURL {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_num_retries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance_request_timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] goodness_function = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] graceful_shutdown_timeout = 5 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] group_api_class = cinder.group.api.API {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] host = devstack {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_compress_on_upload = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_conversion_address_space_limit = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_conversion_cpu_limit = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_conversion_disable = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_upload_use_cinder_backend = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_upload_use_internal_tenant = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_volume_cache_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_volume_cache_max_count = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] image_volume_cache_max_size_gb = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] init_host_max_objects_retrieval = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] instance_format = [instance: %(uuid)s] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] iscsi_target_flags = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] iscsi_write_cache = on {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] iser_helper = tgtadm {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] iser_ip_address = 192.168.122.68 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] iser_port = 3260 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_color = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_config_append = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_dir = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_file = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_options = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_rotate_interval = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_rotate_interval_type = days {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] log_rotation_type = none {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] max_age = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] max_logfile_count = 30 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] max_logfile_size_mb = 200 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] max_over_subscription_ratio = 20.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] message_reap_interval = 86400 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] message_ttl = 2592000 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] migration_create_volume_timeout_secs = 300 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] monkey_patch = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] monkey_patch_modules = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] my_ip = 192.168.122.68 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] no_snapshot_gb_quota = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] num_iser_scan_tries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] num_shell_tries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] num_volume_device_scan_tries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] nvmeof_conn_info_version = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] nvmet_ns_id = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] nvmet_port_id = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_max_limit = 1000 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_volume_ext_list = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_volume_listen_port = 8776 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_volume_use_ssl = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] osapi_volume_workers = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] per_volume_size_limit = -1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] periodic_fuzzy_delay = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] periodic_interval = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] public_endpoint = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] publish_errors = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_backup_gigabytes = 1000 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_backups = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_gigabytes = 1000 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_groups = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_snapshots = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] quota_volumes = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] rate_limit_burst = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] rate_limit_except_level = CRITICAL {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] rate_limit_interval = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] reinit_driver_count = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] replication_device = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] report_discard_supported = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] report_interval = 120 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] reservation_clean_interval = 86400 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] reservation_expire = 86400 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] reserved_image_namespaces = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] reserved_percentage = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] rpc_response_timeout = 120 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] run_external_periodic_tasks = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] scst_target_driver = iscsi {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] scst_target_iqn_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_down_time = 720 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] shell_completion = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85443]: INFO cinder.volume.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] snapshot_name_template = snapshot-%s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85443) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] split_loggers = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] state_path = /opt/stack/data/cinder {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] storage_availability_zone = nova {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] storage_protocol = iSCSI {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] syslog_log_facility = LOG_USER {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] target_helper = lioadm {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] target_ip_address = 192.168.122.68 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] target_port = 3260 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] target_protocol = iscsi {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] target_secondary_ip_addresses = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] trace_flags = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] transport_url = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] until_refresh = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_chap_auth = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_default_quota_class = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_journal = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_json = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_multipath_for_image_xfer = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_stderr = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] use_syslog = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] verify_glance_signatures = enabled {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_api_class = cinder.volume.api.API {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_backend_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_clear = zero {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_clear_ionice = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_clear_size = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_copy_bps_limit = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_dd_blocksize = 1M {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_name_template = volume-%s {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_service_inithost_offload = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volume_usage_audit_period = month {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] zoning_mode = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_concurrency.disable_process_locking = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.auth_section = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.auth_type = password {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.auth_version = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.cache = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.include_service_catalog = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.insecure = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.interface = public {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_password = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcache_username = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.region_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.service_type = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.backend = dogpile.cache.null {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.backend_argument = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.backend_expiration_time = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.config_prefix = cache.oslo {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.debug_cache_backend = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.enable_retry_client = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.enable_socket_keepalive = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.expiration_time = 600 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.hashclient_retry_attempts = 2 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_dead_retry = 300 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_pool_maxsize = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_sasl_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.password = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.proxies = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.redis_db = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.redis_server = localhost:6379 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.retry_attempts = 2 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.retry_delay = 0.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.socket_keepalive_count = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.socket_keepalive_idle = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.socket_keepalive_interval = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.socket_timeout = 1.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.tls_allowed_ciphers = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.tls_cafile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.tls_certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.tls_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.tls_keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cache.username = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] coordination.backend_url = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.asyncio_connection = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.asyncio_slave_connection = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.backend = sqlalchemy {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.connection = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.connection_debug = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.connection_parameters = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.connection_recycle_time = 3600 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.connection_trace = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.db_inc_retry_interval = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.db_max_retries = 20 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.db_max_retry_interval = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.db_retry_interval = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.max_overflow = 50 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.max_pool_size = 5 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.max_retries = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.mysql_wsrep_sync_wait = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.pool_timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.retry_interval = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.slave_connection = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.sqlite_synchronous = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.synchronous_reader = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] database.use_db_reconnect = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.connection_string = messaging:// {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.es_doc_type = notification {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.es_scroll_size = 10000 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.es_scroll_time = 2m {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.filter_error_trace = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.hmac_keys = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.sentinel_service_name = mymaster {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.socket_timeout = 0.1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.trace_requests = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler.trace_sqlalchemy = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler_jaeger.process_tags = {} {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler_jaeger.service_name_prefix = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] profiler_otlp.service_name_prefix = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.enforce_new_defaults = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.enforce_scope = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.policy_default_rule = default {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85443) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 01 06:40:14 devstack cinder-volume[85443]: WARNING cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.policy_file = policy.yaml {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.group = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: WARNING cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.helper_command = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Running cmd (subprocess): mount.quobyte {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] privsep_osbrick.user = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.group = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.helper_command = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] cinder_sys_admin.user = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.auth_section = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.auth_type = password {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.cafile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.collect_timing = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.insecure = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.send_service_user_token = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.split_loggers = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] service_user.timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.auth_section = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.auth_type = password {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.collect_timing = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.insecure = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.region_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.split_loggers = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] glance.timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.backend_availability_zone = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.chap_password = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.chap_username = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.disk_geometry = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.driver_client_cert = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.driver_client_cert_key = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.driver_data_namespace = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.driver_use_ssl = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.extra_capabilities = {} {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.filter_function = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.goodness_function = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.iscsi_target_flags = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.iscsi_write_cache = on {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.iser_helper = tgtadm {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.iser_port = 3260 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_host = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_login = admin {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_mount_options = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_password = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_private_key = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_share_path = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.num_shell_tries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.quobyte_volume_url = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.replication_device = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.report_discard_supported = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.reserved_percentage = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.target_helper = tgtadm {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.target_port = 3260 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.target_protocol = iscsi {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.trace_flags = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.unique_fqdn_network = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.use_chap_auth = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_backend_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_clear = zero {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_clear_ionice = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_clear_size = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_reports.file_event_handler = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_reports.log_dir = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.backend_availability_zone = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.backend_host = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.chap_password = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.chap_username = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.chiscsi_conf = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.disk_geometry = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.driver_client_cert = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.driver_data_namespace = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.driver_use_ssl = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.extra_capabilities = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.filter_function = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.goodness_function = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.iser_helper = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.iser_ip_address = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.iser_port = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.iser_target_prefix = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_host = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_login = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_mount_options = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_password = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_private_key = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_share_path = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_ssh_port = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.num_shell_tries = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.nvmet_port_id = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.replication_device = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.report_discard_supported = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=85443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.reserved_percentage = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.scst_target_driver = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.storage_protocol = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.target_helper = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.target_ip_address = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.target_port = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.target_prefix = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: INFO cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 ... Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.target_protocol = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 -c /etc/quobyte/client-cinder.cfg {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.trace_flags = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.use_chap_auth = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_clear = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_clear_size = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] QuobyteHD.volumes_dir = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:14 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_notifications.driver = [] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_notifications.retry = -1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] key_manager.fixed_key = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.barbican_api_version = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.barbican_endpoint = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.barbican_endpoint_type = public {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.barbican_region_name = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.cafile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.collect_timing = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.insecure = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.number_of_retries = 60 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.retry_delay = 1 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.send_service_user_token = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.split_loggers = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.verify_ssl = True {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican.verify_ssl_path = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.auth_section = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.auth_type = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.cafile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.certfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.collect_timing = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.insecure = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.keyfile = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.split_loggers = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] barbican_service_user.timeout = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.approle_role_id = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.approle_secret_id = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.kv_mountpoint = secret {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.kv_path = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.kv_version = 2 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.namespace = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.root_token_id = **** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.ssl_ca_crt_file = None {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.timeout = 60.0 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.use_ssl = False {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:15 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] ******************************************************************************** {{(pid=85225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 01 06:40:15 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 -c /etc/quobyte/client-cinder.cfg Jul 01 06:40:15 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:15 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:15 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.794s {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:15 devstack cinder-volume[85443]: INFO cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 succeeded Jul 01 06:40:15 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=85443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:15 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.809s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:15 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:15 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:15 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:16 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.637s {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:16 devstack cinder-volume[85443]: INFO cinder.volume.driver [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Driver hasn't implemented _init_vendor_properties() Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG cinder.volume.driver [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85443) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG oslo_db.sqlalchemy.engines [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85443) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG dbcounter [-] [85443] Writer thread running {{(pid=85443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG cinder.db.api [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Building query based on filter {{(pid=85443) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG cinder.image.image_utils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85443) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 01 06:40:16 devstack cinder-volume[85443]: INFO cinder.keymgr.migration [None req-cef28f70-75fc-45d2-a78d-e7d974318082 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=85443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=85443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:16 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:16 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:16 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:17 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.641s {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG cinder.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Notifying Schedulers of capabilities ... {{(pid=85443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:40:17 devstack cinder-volume[85443]: INFO cinder.volume.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Driver initialization completed successfully. Jul 01 06:40:17 devstack cinder-volume[85443]: INFO cinder.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Initiating service 3 cleanup Jul 01 06:40:17 devstack cinder-volume[85443]: INFO cinder.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Service 3 cleanup completed. Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG cinder.service [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Creating RPC server for service cinder-volume {{(pid=85443) start /opt/stack/cinder/cinder/service.py:231}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG cinder.service [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85443) start /opt/stack/cinder/cinder/service.py:237}} Jul 01 06:40:17 devstack cinder-volume[85443]: INFO cinder.volume.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=85443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=85443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:17 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:17 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:17 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:18 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:18 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.753s {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:18 devstack cinder-volume[85443]: INFO cinder.volume.manager [None req-cd1a0c38-dc3b-49f6-866a-4fb81f8b4f8d None None] Driver post RPC initialization completed successfully. Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=85443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG cinder.volume.drivers.quobyte [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=85443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:22 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:22 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:22 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG oslo_concurrency.processutils [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.594s {{(pid=85443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:22 devstack cinder-volume[85443]: DEBUG cinder.manager [None req-b42134d7-77d6-4567-b8b0-231ef313ab77 None None] Notifying Schedulers of capabilities ... {{(pid=85443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:40:24 devstack cinder-volume[85225]: INFO oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Caught SIGTERM, stopping children Jul 01 06:40:24 devstack cinder-volume[85225]: DEBUG oslo_concurrency.lockutils [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Acquiring lock "singleton_lock" {{(pid=85225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:40:24 devstack cinder-volume[85225]: DEBUG oslo_concurrency.lockutils [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Acquired lock "singleton_lock" {{(pid=85225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:40:24 devstack cinder-volume[85225]: DEBUG oslo_concurrency.lockutils [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Releasing lock "singleton_lock" {{(pid=85225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:40:24 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Stop services. {{(pid=85225) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 01 06:40:24 devstack cinder-volume[85225]: DEBUG oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Killing children. {{(pid=85225) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 01 06:40:24 devstack cinder-volume[85225]: INFO oslo_service.backend._eventlet.service [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Waiting on 1 children to exit Jul 01 06:40:28 devstack cinder-volume[85443]: DEBUG dbcounter [-] [85443] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:40:28 devstack cinder-volume[85443]: DEBUG dbcounter [-] [85443] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=85443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:40:29 devstack cinder-volume[85443]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 01 06:40:30 devstack cinder-volume[85937]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 01 06:40:30 devstack cinder-volume[85937]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 06:40:30 devstack cinder-volume[85937]: we strongly recommend against using it for new projects. Jul 01 06:40:30 devstack cinder-volume[85937]: If you are already using Eventlet, we recommend migrating to a different Jul 01 06:40:30 devstack cinder-volume[85937]: framework. For more detail see Jul 01 06:40:30 devstack cinder-volume[85937]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 06:40:30 devstack cinder-volume[85937]: import eventlet # noqa Jul 01 06:40:30 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Acquiring lock "singleton_lock" {{(pid=85443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:40:30 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Acquired lock "singleton_lock" {{(pid=85443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:40:30 devstack cinder-volume[85443]: DEBUG oslo_concurrency.lockutils [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Releasing lock "singleton_lock" {{(pid=85443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:40:30 devstack cinder-volume[85443]: WARNING amqp [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 06:40:30 devstack cinder-volume[85443]: WARNING amqp [None req-7cda849b-9bf4-46e5-86a8-0c7afd5b7375 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 06:40:32 devstack cinder-volume[85937]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 06:40:32 devstack cinder-volume[85937]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 06:40:32 devstack cinder-volume[85937]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 06:40:33 devstack cinder-volume[85937]: INFO dbcounter [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Registered counter for database cinder Jul 01 06:40:33 devstack cinder-volume[85937]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:33 devstack cinder-volume[85937]: DEBUG dbcounter [-] [85937] Writer thread running {{(pid=85937) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 06:40:33 devstack cinder-volume[85937]: INFO cinder.rpc [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 01 06:40:33 devstack cinder-volume[85937]: INFO cinder.rpc [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 01 06:40:33 devstack cinder-volume[85937]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:33 devstack cinder-volume[85937]: INFO cinder.volume.manager [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Determined volume DB was empty at startup. Jul 01 06:40:33 devstack cinder-volume[85937]: DEBUG cinder.volume.manager [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85937) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 01 06:40:33 devstack cinder-volume[85937]: WARNING stevedore.named [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 06:40:33 devstack cinder-volume[85937]: WARNING castellan.key_manager [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:40:33 devstack cinder-volume[85937]: WARNING cinder.keymgr.conf_key_mgr [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 06:40:33 devstack cinder-volume[85937]: INFO cinder.volume.manager [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_db.sqlalchemy.engines [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:34 devstack cinder-volume[85937]: INFO oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Starting 1 workers Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Started child 86219 {{(pid=85937) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Full set of CONF: {{(pid=85937) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] ******************************************************************************** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] Configuration options gathered from: {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] ================================================================================ {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] allow_availability_zone_fallback = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[86219]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] allow_compression_on_image_upload = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] allowed_direct_url_schemes = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] api_rate_limit = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] auth_strategy = keystone {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_availability_zone = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_host = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_stats_polling_interval = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backup_api_class = cinder.backup.api.API {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backup_name_template = backup-%s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backup_use_same_host = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backup_use_temp_snapshot = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] chap_password = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] chap_username = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_internal_tenant_project_id = b432b94041f446e5b4c0458c5abfb2d4 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_internal_tenant_user_id = 25b5019362ac46ab91876e1214f01661 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cluster = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] compression_format = gzip {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] compute_api_class = cinder.compute.nova.API {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] config_dir = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] config_source = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] control_exchange = openstack {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] debug = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] default_availability_zone = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] default_group_type = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] default_volume_type = QuobyteHD {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] disk_geometry = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] driver_client_cert = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] driver_client_cert_key = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] driver_data_namespace = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] driver_ssl_cert_path = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] driver_ssl_cert_verify = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] driver_use_ssl = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] enable_new_services = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] enable_unsupported_driver = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] enabled_backends = ['QuobyteHD'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] enforce_multipath_for_image_xfer = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] filter_function = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_api_insecure = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_api_ssl_compression = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_ca_certificates_file = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_catalog_info = image:glance:publicURL {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_num_retries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance_request_timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] goodness_function = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] graceful_shutdown_timeout = 5 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] group_api_class = cinder.group.api.API {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] host = devstack {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_compress_on_upload = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_conversion_address_space_limit = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_conversion_cpu_limit = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_conversion_disable = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_upload_use_cinder_backend = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_upload_use_internal_tenant = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_volume_cache_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_volume_cache_max_count = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] image_volume_cache_max_size_gb = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] init_host_max_objects_retrieval = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] instance_format = [instance: %(uuid)s] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] iscsi_target_flags = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] iscsi_write_cache = on {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] iser_helper = tgtadm {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] iser_ip_address = 192.168.122.68 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] iser_port = 3260 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_color = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_config_append = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_dir = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_file = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_options = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_rotate_interval = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_rotate_interval_type = days {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] log_rotation_type = none {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] max_age = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] max_logfile_count = 30 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] max_logfile_size_mb = 200 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] max_over_subscription_ratio = 20.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] message_reap_interval = 86400 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] message_ttl = 2592000 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] migration_create_volume_timeout_secs = 300 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] monkey_patch = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] monkey_patch_modules = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] my_ip = 192.168.122.68 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] no_snapshot_gb_quota = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] num_iser_scan_tries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] num_shell_tries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] num_volume_device_scan_tries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] nvmeof_conn_info_version = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] nvmet_ns_id = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] nvmet_port_id = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_max_limit = 1000 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_volume_ext_list = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_volume_listen = 0.0.0.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_volume_listen_port = 8776 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_volume_use_ssl = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] osapi_volume_workers = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] per_volume_size_limit = -1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] periodic_fuzzy_delay = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] periodic_interval = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] project_id_regex = [0-9a-f\-]+ {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] public_endpoint = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] publish_errors = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_backup_gigabytes = 1000 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_backups = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86219) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_gigabytes = 1000 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_groups = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_snapshots = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] quota_volumes = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] rate_limit_burst = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] rate_limit_except_level = CRITICAL {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] rate_limit_interval = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] reinit_driver_count = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] replication_device = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] report_discard_supported = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] report_interval = 120 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] reservation_clean_interval = 86400 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] reservation_expire = 86400 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] reserved_image_namespaces = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] reserved_percentage = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] rpc_response_timeout = 120 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] run_external_periodic_tasks = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] scst_target_driver = iscsi {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] scst_target_iqn_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_down_time = 720 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] shell_completion = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] snapshot_name_template = snapshot-%s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] split_loggers = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] state_path = /opt/stack/data/cinder {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] storage_availability_zone = nova {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] storage_protocol = iSCSI {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] syslog_log_facility = LOG_USER {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] target_helper = lioadm {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] target_ip_address = 192.168.122.68 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] target_port = 3260 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] target_protocol = iscsi {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] target_secondary_ip_addresses = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] trace_flags = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] transfer_api_class = cinder.transfer.api.API {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] transport_url = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] until_refresh = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_chap_auth = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_default_quota_class = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_journal = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_json = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_multipath_for_image_xfer = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_stderr = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] use_syslog = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] verify_glance_signatures = enabled {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_api_class = cinder.volume.api.API {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_backend_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_clear = zero {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_clear_ionice = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_clear_size = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_copy_bps_limit = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_dd_blocksize = 1M {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_name_template = volume-%s {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_service_inithost_offload = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volume_usage_audit_period = month {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] zoning_mode = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_concurrency.disable_process_locking = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.auth_section = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.auth_type = password {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.auth_version = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.cache = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.delay_auth_decision = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.http_connect_timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.include_service_catalog = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.insecure = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.interface = public {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_password = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcache_username = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.region_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.service_token_roles_required = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.service_type = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.token_cache_time = 300 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.backend = dogpile.cache.null {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.backend_argument = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.backend_expiration_time = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.config_prefix = cache.oslo {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.debug_cache_backend = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.enable_retry_client = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.enable_socket_keepalive = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.expiration_time = 600 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.hashclient_retry_attempts = 2 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_dead_retry = 300 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_pool_maxsize = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_sasl_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.password = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.proxies = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.redis_db = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.redis_sentinel_service_name = mymaster {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.redis_server = localhost:6379 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.retry_attempts = 2 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.retry_delay = 0.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.socket_keepalive_count = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.socket_keepalive_idle = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.socket_keepalive_interval = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.socket_timeout = 1.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.tls_allowed_ciphers = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.tls_cafile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.tls_certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.tls_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.tls_keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cache.username = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] coordination.backend_url = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.asyncio_connection = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.asyncio_slave_connection = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.backend = sqlalchemy {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.connection = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.connection_debug = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.connection_parameters = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.connection_recycle_time = 3600 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.connection_trace = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.db_inc_retry_interval = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.db_max_retries = 20 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.db_max_retry_interval = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.db_retry_interval = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.max_overflow = 50 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.max_pool_size = 5 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.max_retries = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.mysql_wsrep_sync_wait = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.pool_timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.retry_interval = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.slave_connection = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.sqlite_synchronous = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.synchronous_reader = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] database.use_db_reconnect = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.connection_string = messaging:// {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.es_doc_type = notification {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.es_scroll_size = 10000 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.es_scroll_time = 2m {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.filter_error_trace = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.hmac_keys = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.sentinel_service_name = mymaster {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.socket_timeout = 0.1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.trace_requests = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler.trace_sqlalchemy = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler_jaeger.process_tags = {} {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler_jaeger.service_name_prefix = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] profiler_otlp.service_name_prefix = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.enforce_new_defaults = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.enforce_scope = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.policy_default_rule = default {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.policy_file = policy.yaml {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_policy.remote_timeout = 60.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.group = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.helper_command = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] privsep_osbrick.user = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86219) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 01 06:40:34 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.group = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.helper_command = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] cinder_sys_admin.user = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.auth_section = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.auth_type = password {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.cafile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Running cmd (subprocess): mount.quobyte {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.collect_timing = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.insecure = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.send_service_user_token = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.split_loggers = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] service_user.timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.auth_section = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.auth_type = password {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.collect_timing = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.insecure = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.region_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.split_loggers = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] glance.timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.backend_availability_zone = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.chap_password = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.chap_username = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.disk_geometry = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.driver_client_cert = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.driver_client_cert_key = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.driver_data_namespace = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.driver_use_ssl = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.enable_unsupported_driver = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.extra_capabilities = {} {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.filter_function = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.goodness_function = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.iscsi_target_flags = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.iscsi_write_cache = on {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.iser_helper = tgtadm {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.iser_port = 3260 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_host = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_login = admin {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_mount_options = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_password = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_private_key = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_share_path = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_ssh_port = 22 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.num_shell_tries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.nvmet_port_id = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_client_cfg = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.quobyte_volume_url = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.replication_device = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.report_discard_supported = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.reserved_percentage = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.scst_target_driver = iscsi {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.scst_target_iqn_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.storage_protocol = iSCSI {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.target_helper = tgtadm {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.target_port = 3260 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.target_protocol = iscsi {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.trace_flags = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.unique_fqdn_network = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.use_chap_auth = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_backend_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_clear = zero {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_clear_ionice = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_clear_size = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_reports.file_event_handler = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_reports.log_dir = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.backend_availability_zone = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.backend_host = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.chap_password = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.chap_username = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.chiscsi_conf = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.disk_geometry = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.driver_client_cert = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.driver_client_cert_key = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.driver_data_namespace = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.driver_use_ssl = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.extra_capabilities = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.filter_function = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.goodness_function = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.iscsi_target_flags = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.iscsi_write_cache = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.iser_helper = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.iser_ip_address = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.iser_port = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.iser_target_prefix = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_host = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_login = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_mount_options = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_password = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_private_key = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_share_path = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack quobyte-client[86224]: Reading configuration file: /etc/quobyte/client.cfg Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_ssh_port = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.num_shell_tries = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nvmet_ns_id = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack quobyte-client[86224]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.nvmet_port_id = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.replication_device = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.report_discard_supported = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.reserved_percentage = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.scst_target_driver = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.storage_protocol = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.target_helper = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.target_ip_address = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.target_port = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.target_prefix = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.target_protocol = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.trace_flags = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.unique_fqdn_network = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.use_chap_auth = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_clear = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_clear_ionice = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_clear_size = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] QuobyteHD.volumes_dir = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.ssl_version = {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_notifications.driver = [] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_notifications.retry = -1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] key_manager.fixed_key = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.barbican_api_version = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.barbican_endpoint = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.barbican_endpoint_type = public {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.barbican_region_name = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.cafile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.collect_timing = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.insecure = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.number_of_retries = 60 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.retry_delay = 1 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.send_service_user_token = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.split_loggers = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.verify_ssl = True {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican.verify_ssl_path = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.auth_section = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.auth_type = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.cafile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.certfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.collect_timing = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.insecure = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.keyfile = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.split_loggers = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] barbican_service_user.timeout = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.approle_role_id = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.approle_secret_id = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.kv_mountpoint = secret {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.kv_path = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.kv_version = 2 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.namespace = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.root_token_id = **** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.ssl_ca_crt_file = None {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.timeout = 60.0 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.use_ssl = False {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 06:40:34 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:34 devstack cinder-volume[85937]: DEBUG oslo_service.backend._eventlet.service [None req-c0f87857-4d0d-49cc-88f3-a05aa3abf0aa None None] ******************************************************************************** {{(pid=85937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 01 06:40:34 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.584s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:34 devstack cinder-volume[86219]: INFO cinder.volume.driver [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Driver hasn't implemented _init_vendor_properties() Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.driver [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86219) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_db.sqlalchemy.engines [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86219) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writer thread running {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.db.api [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Building query based on filter {{(pid=86219) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86219) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:35 devstack cinder-volume[86219]: INFO cinder.keymgr.migration [None req-ae31afb1-ace5-4c86-8343-ac080c6d3b45 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 01 06:40:35 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:35 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:35 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.638s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:40:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Driver initialization completed successfully. Jul 01 06:40:35 devstack cinder-volume[86219]: INFO cinder.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Initiating service 3 cleanup Jul 01 06:40:35 devstack cinder-volume[86219]: INFO cinder.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Service 3 cleanup completed. Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG cinder.service [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Creating RPC server for service cinder-volume {{(pid=86219) start /opt/stack/cinder/cinder/service.py:231}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG cinder.service [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86219) start /opt/stack/cinder/cinder/service.py:237}} Jul 01 06:40:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:40:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:40:35 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:40:35 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:40:36 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Jul 01 06:40:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.636s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:40:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b51a94af-17fb-4f8a-bc6d-adad805aaf0b None None] Driver post RPC initialization completed successfully. Jul 01 06:40:44 devstack cinder-volume[85937]: DEBUG dbcounter [-] [85937] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85937) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:40:45 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:40:46 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=3 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:41:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:41:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 6 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:41:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Flow 'volume_create_manager' (18ea1b7d-61bf-4635-beb9-42b211eb290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306405f6-8498-45ad-9f4b-b15cb75f7f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306405f6-8498-45ad-9f4b-b15cb75f7f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1284420562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426c2004-ada6-4dd0-beeb-63a784317fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442778cc501b4c5fa23069148683b24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:41:32Z,use_quota=True,user_id='982bef7f3d7c4a93afbbffb44d81c30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279c4d14-7a9f-4582-ab34-ce3a90088d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279c4d14-7a9f-4582-ab34-ce3a90088d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c120d00-f507-4b8d-b42c-ee376dd0373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c120d00-f507-4b8d-b42c-ee376dd0373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426c2004-ada6-4dd0-beeb-63a784317fbe', 'volume_name': 'volume-426c2004-ada6-4dd0-beeb-63a784317fbe', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6640828-f115-4c22-972b-58ec820d65ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6640828-f115-4c22-972b-58ec820d65ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d62694-7fa7-48e0-8e07-7d7559220f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:41:32 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Volume 426c2004-ada6-4dd0-beeb-63a784317fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426c2004-ada6-4dd0-beeb-63a784317fbe', 'volume_size': 1} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1284420562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426c2004-ada6-4dd0-beeb-63a784317fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442778cc501b4c5fa23069148683b24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:41:32Z,use_quota=True,user_id='982bef7f3d7c4a93afbbffb44d81c30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Creating volume 426c2004-ada6-4dd0-beeb-63a784317fbe {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:41:32 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:41:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:41:32 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe 1073741824 Jul 01 06:41:32 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:41:33 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Jul 01 06:41:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe 1073741824" returned: 0 in 1.281s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:41:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:41:33 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe Jul 01 06:41:33 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:41:34 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe" returned: 0 in 0.882s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d62694-7fa7-48e0-8e07-7d7559220f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426c2004-ada6-4dd0-beeb-63a784317fbe', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4074b345-9e83-41a7-b875-da15d0923176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:41:34 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Volume volume-426c2004-ada6-4dd0-beeb-63a784317fbe (426c2004-ada6-4dd0-beeb-63a784317fbe): created successfully Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4074b345-9e83-41a7-b875-da15d0923176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:41:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Flow 'volume_create_manager' (18ea1b7d-61bf-4635-beb9-42b211eb290f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:41:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2fe2a630-6606-4335-bbe3-fb01423ee63b tempest-TaggedAttachmentsTest-94088558 None] Created volume successfully. Jul 01 06:41:44 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:41:44 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Flow 'volume_create_manager' (6ce0fe1c-515e-46e9-9161-7ed4f228c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50947f8-0cb9-4d6e-b5bf-e3a069e23f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50947f8-0cb9-4d6e-b5bf-e3a069e23f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-614553466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11c57cf-3d84-4555-b2f9-040be5540a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670bca37ee64494c83ebe71193e93986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:42:21Z,use_quota=True,user_id='e2b8c514388e44619ae6540c8f946f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50a8ea3-f13f-442b-85b2-9588f4cc9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50a8ea3-f13f-442b-85b2-9588f4cc9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8674d6eb-2d12-490d-8ddc-f8159ba08441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8674d6eb-2d12-490d-8ddc-f8159ba08441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11c57cf-3d84-4555-b2f9-040be5540a75', 'volume_name': 'volume-f11c57cf-3d84-4555-b2f9-040be5540a75', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7351bb36-b06b-4177-91c5-c225627c4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7351bb36-b06b-4177-91c5-c225627c4bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23974f71-7ddd-4cd6-8da8-c7fba940d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Volume f11c57cf-3d84-4555-b2f9-040be5540a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11c57cf-3d84-4555-b2f9-040be5540a75', 'volume_size': 1} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-614553466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11c57cf-3d84-4555-b2f9-040be5540a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670bca37ee64494c83ebe71193e93986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:42:21Z,use_quota=True,user_id='e2b8c514388e44619ae6540c8f946f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Creating volume f11c57cf-3d84-4555-b2f9-040be5540a75 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:42:21 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:42:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:21 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 1073741824 Jul 01 06:42:21 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:23 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 1073741824" returned: 0 in 1.843s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:23 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 Jul 01 06:42:23 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:24 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75" returned: 0 in 1.043s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] <== create_volume: return (2982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.995s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23974f71-7ddd-4cd6-8da8-c7fba940d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11c57cf-3d84-4555-b2f9-040be5540a75', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289702b2-14ee-428e-95e8-f7e871bdb86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:24 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Volume volume-f11c57cf-3d84-4555-b2f9-040be5540a75 (f11c57cf-3d84-4555-b2f9-040be5540a75): created successfully Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289702b2-14ee-428e-95e8-f7e871bdb86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Flow 'volume_create_manager' (6ce0fe1c-515e-46e9-9161-7ed4f228c031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:42:24 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7eff7d14-9df6-483d-8a97-ca2562b4f194 tempest-VolumesAdminNegativeTest-1286894055 None] Created volume successfully. Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:26 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:42:26 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Acquiring lock "cinder-f11c57cf-3d84-4555-b2f9-040be5540a75-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Lock "cinder-f11c57cf-3d84-4555-b2f9-040be5540a75-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Acquiring lock "cinder-quobyte-f11c57cf-3d84-4555-b2f9-040be5540a75" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:42:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Lock "cinder-quobyte-f11c57cf-3d84-4555-b2f9-040be5540a75" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:42:26 devstack cinder-volume[86219]: INFO oslo.privsep.daemon [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmyv792_f/privsep.sock'] Jul 01 06:42:26 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmyv792_f/privsep.sock Jul 01 06:42:26 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:27 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.489s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:42:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:42:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 7 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:42:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 06:42:27 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 06:42:28 devstack cinder-volume[86219]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 01 06:42:29 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:29 devstack cinder-volume[86219]: INFO oslo.privsep.daemon [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Spawned new privsep daemon via rootwrap Jul 01 06:42:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Accepted privsep connection to /tmp/tmpmyv792_f/privsep.sock {{(pid=86219) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 01 06:42:29 devstack cinder-volume[86219]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 01 06:42:29 devstack cinder-volume[86219]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 01 06:42:29 devstack cinder-volume[86219]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 01 06:42:29 devstack cinder-volume[86219]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87314 Jul 01 06:42:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1563e0-61f3-48c4-954b-32f93cc29025]: (2,) {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:42:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3395a325-207f-4123-b7fe-b99eb456f589]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:42:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:29 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 Jul 01 06:42:29 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:30 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75" returned: 0 in 0.969s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:30 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75 Jul 01 06:42:30 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:31 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f11c57cf-3d84-4555-b2f9-040be5540a75" returned: 0 in 1.696s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Lock "cinder-quobyte-f11c57cf-3d84-4555-b2f9-040be5540a75" released by "delete_volume" :: held 5.276s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:42:32 devstack cinder-volume[86219]: WARNING cinder.quota [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:42:32 devstack cinder-volume[86219]: WARNING cinder.quota [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Created reservations ['f58cce1e-3cb1-411e-95da-aca48dda62e1', 'fd8aae94-7350-4c1f-93f0-0c7400ab5a57', '27addc75-97f0-4591-b238-3415b8cd6e2a', '0039c0f4-6c2a-4e32-96dc-643755b7ffa8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:32 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:42:32 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:34 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.991s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:34 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:42:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Deleted volume successfully. Jul 01 06:42:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1be07907-c3a5-498a-8391-3bc2365b31dd tempest-VolumesAdminNegativeTest-1286894055 None] Lock "cinder-f11c57cf-3d84-4555-b2f9-040be5540a75-delete_volume" released by "delete_volume" :: held 8.229s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Flow 'volume_create_manager' (e0fbe484-15c8-4dee-9498-4a33ad2050b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fd666f-fdcd-4e43-9ba3-d9871c58d365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fd666f-fdcd-4e43-9ba3-d9871c58d365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-699590673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2b2a35c69415bb2b4db9fb73f7278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:42:38Z,use_quota=True,user_id='6121b25d6f474b4186939ad223a56abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b8f845-7988-408e-af1d-947ac5e35857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b8f845-7988-408e-af1d-947ac5e35857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824c182a-d1f3-4ce2-9208-52e221d10eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824c182a-d1f3-4ce2-9208-52e221d10eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a', 'volume_name': 'volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90bdc74-e0ef-4196-884c-76f0d7cf77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90bdc74-e0ef-4196-884c-76f0d7cf77f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d1e9fe-029b-4eab-8d70-050ec09bc20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:37 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Volume 02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a', 'volume_size': 1} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-699590673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2b2a35c69415bb2b4db9fb73f7278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:42:38Z,use_quota=True,user_id='6121b25d6f474b4186939ad223a56abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Creating volume 02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:42:37 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:42:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:38 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a 1073741824 Jul 01 06:42:38 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:39 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a 1073741824" returned: 0 in 1.404s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:39 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a Jul 01 06:42:39 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:40 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" returned: 0 in 0.988s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d1e9fe-029b-4eab-8d70-050ec09bc20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc693168-cb47-4a6e-81f3-130231212800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Volume volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a (02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a): created successfully Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc693168-cb47-4a6e-81f3-130231212800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Flow 'volume_create_manager' (e0fbe484-15c8-4dee-9498-4a33ad2050b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:42:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3ae10de3-fb33-4d6a-8be5-d8781c39ce03 tempest-DeleteServersTestJSON-1503312888 None] Created volume successfully. Jul 01 06:42:47 devstack cinder-volume[86219]: WARNING py.warnings [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 01 06:42:47 devstack cinder-volume[86219]: .first() Jul 01 06:42:47 devstack cinder-volume[86219]: Jul 01 06:42:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:47 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062aa49-57fc-4dba-b704-a184b4285521]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:42:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:47 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe Jul 01 06:42:47 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Flow 'volume_create_manager' (d67b1a5d-bef0-4272-9d34-488626eca2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918f0e32-a7e0-4205-a323-423542246b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918f0e32-a7e0-4205-a323-423542246b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1575110846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d8b74f-d807-43aa-9566-b4920fbbbb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ecdb4361404d04ba23bc05773d18bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:42:48Z,use_quota=True,user_id='c018c5446bc34751a50942e6ad30e7df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287712b5-84c1-49fe-945d-2f8b6715428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287712b5-84c1-49fe-945d-2f8b6715428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a515724c-3454-47bd-b0c3-3905bbf972c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a515724c-3454-47bd-b0c3-3905bbf972c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d8b74f-d807-43aa-9566-b4920fbbbb4f', 'volume_name': 'volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6eb8a4a-ade2-4f02-9021-ac4a15056e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6eb8a4a-ade2-4f02-9021-ac4a15056e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09199cd4-cbfd-4476-a79d-a748af6a62be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Volume a3d8b74f-d807-43aa-9566-b4920fbbbb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f', 'volume_size': 1} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:48 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe" returned: 0 in 0.886s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.548s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6349f069-5bd5-4e99-aa07-5e83e646e4ba]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-426c2004-ada6-4dd0-beeb-63a784317fbe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e299794-6220-40dd-a796-c520f9dd7b64', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:42:48 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a Jul 01 06:42:48 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-fe2a39f5-e945-4a87-9902-9d7f4d004b50 req-5186e3bb-2ee6-4d1f-bb76-2bb3601a0875 tempest-TaggedAttachmentsTest-94088558 None] attachment_update completed successfully. Jul 01 06:42:49 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" returned: 0 in 1.015s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.046s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1575110846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d8b74f-d807-43aa-9566-b4920fbbbb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ecdb4361404d04ba23bc05773d18bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:42:48Z,use_quota=True,user_id='c018c5446bc34751a50942e6ad30e7df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Creating volume a3d8b74f-d807-43aa-9566-b4920fbbbb4f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:42:49 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:49 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f 1073741824 Jul 01 06:42:49 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ed40e84-ad49-4a50-a11c-d51f8bf23f6a', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:42:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-f5269898-2856-4e2f-9ef6-5b96de1de488 req-45ccadad-1743-4ff8-9afb-10f7c19d0e46 tempest-DeleteServersTestJSON-1503312888 None] attachment_update completed successfully. Jul 01 06:42:50 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f 1073741824" returned: 0 in 1.148s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:42:51 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f Jul 01 06:42:51 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:42:51 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" returned: 0 in 0.820s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09199cd4-cbfd-4476-a79d-a748af6a62be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3631dbb4-423b-4661-baf2-0a1c28dd78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:42:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Volume volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f (a3d8b74f-d807-43aa-9566-b4920fbbbb4f): created successfully Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3631dbb4-423b-4661-baf2-0a1c28dd78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:42:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Flow 'volume_create_manager' (d67b1a5d-bef0-4272-9d34-488626eca2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:42:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-03709e02-1d56-4661-91e8-819451b74d70 tempest-ServerActionsTestOtherA-822627629 None] Created volume successfully. Jul 01 06:42:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-d736bb23-9ae6-43cc-bc6b-26012abdb6e0 req-7c033084-fa55-4ee5-ae13-9fd0e78df56e tempest-TaggedAttachmentsTest-94088558 None] Terminate volume connection completed successfully. Jul 01 06:42:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-d736bb23-9ae6-43cc-bc6b-26012abdb6e0 req-7c033084-fa55-4ee5-ae13-9fd0e78df56e tempest-TaggedAttachmentsTest-94088558 None] Deleting attachment 8e299794-6220-40dd-a796-c520f9dd7b64. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:42:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-380a9eb5-0851-43f7-b47e-d9dc87435f46 req-fab534f1-01bc-4d98-871d-537428b9d986 tempest-DeleteServersTestJSON-1503312888 None] Terminate volume connection completed successfully. Jul 01 06:42:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-380a9eb5-0851-43f7-b47e-d9dc87435f46 req-fab534f1-01bc-4d98-871d-537428b9d986 tempest-DeleteServersTestJSON-1503312888 None] Deleting attachment 4ed40e84-ad49-4a50-a11c-d51f8bf23f6a. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:43:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Acquiring lock "cinder-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:43:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Lock "cinder-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:43:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Acquiring lock "cinder-quobyte-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:43:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Lock "cinder-quobyte-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" acquired by "delete_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:43:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1967e0-7bfb-4a8e-9ba7-b7c951fa3d95]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:43:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:02 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a Jul 01 06:43:02 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:03 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" returned: 0 in 0.903s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:03 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a Jul 01 06:43:03 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:03 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" returned: 0 in 0.815s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Lock "cinder-quobyte-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a" released by "delete_volume" :: held 1.783s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Created reservations ['dc3671c7-cf1f-4048-8fba-b724ac501c3e', '93e6c8dd-262e-4309-b543-0c496b1167a5', '6af61708-d21c-4c71-8810-377732c49353', 'abf8222f-f5d1-4280-a94d-e78f2cb30980'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:43:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:04 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:43:04 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:05 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.031s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:05 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:43:05 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Deleted volume successfully. Jul 01 06:43:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41afaaae-277c-46af-801a-acf991a1299a tempest-DeleteServersTestJSON-1503312888 None] Lock "cinder-02fae5d4-78b2-4fc9-b2a2-edd6c3717d8a-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:43:14 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=36,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:43:15 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=37,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:43:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Acquiring lock "cinder-426c2004-ada6-4dd0-beeb-63a784317fbe-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:43:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Lock "cinder-426c2004-ada6-4dd0-beeb-63a784317fbe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:43:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Acquiring lock "cinder-quobyte-426c2004-ada6-4dd0-beeb-63a784317fbe" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:43:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Lock "cinder-quobyte-426c2004-ada6-4dd0-beeb-63a784317fbe" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:43:18 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d8f991-aedb-467f-aed8-de02edabb52d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:43:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:18 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe Jul 01 06:43:18 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:19 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:19 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe Jul 01 06:43:19 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:20 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-426c2004-ada6-4dd0-beeb-63a784317fbe" returned: 0 in 0.696s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Lock "cinder-quobyte-426c2004-ada6-4dd0-beeb-63a784317fbe" released by "delete_volume" :: held 1.628s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Created reservations ['aa7319a6-f4ea-46b2-8230-e87bd9bcfe44', '3fd3774d-cfb7-47dd-b752-4468076bde97', '2ae72b4c-0f38-4776-ae6b-5faf94e79242', '28729882-e9f3-4952-bc08-87615473281e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:43:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:20 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:43:20 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:21 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:21 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:43:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Deleted volume successfully. Jul 01 06:43:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-860758af-3aa8-4981-85df-de45e54f95ff tempest-TaggedAttachmentsTest-94088558 None] Lock "cinder-426c2004-ada6-4dd0-beeb-63a784317fbe-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:43:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:26 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:43:26 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:27 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.909s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:43:30 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:43:31 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:43:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:43:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:43:35 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a402d61-9b17-4748-801a-984f9244253d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:43:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:35 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f Jul 01 06:43:35 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:36 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" returned: 0 in 1.255s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.273s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:43:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffe2aede-2b78-45e6-98bd-a279718ee6a3', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:43:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-b9d4ad61-0f51-4790-a58c-23958860697c req-31f2467c-bc48-4636-bd49-9a5f1b46ccba tempest-ServerActionsTestOtherA-822627629 None] attachment_update completed successfully. Jul 01 06:43:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-b0326c0b-3bfd-4c8d-b5de-a60bb3cc1b3e tempest-ServerActionsTestOtherA-822627629 None] Terminate volume connection completed successfully. Jul 01 06:43:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-b0326c0b-3bfd-4c8d-b5de-a60bb3cc1b3e tempest-ServerActionsTestOtherA-822627629 None] Deleting attachment ffe2aede-2b78-45e6-98bd-a279718ee6a3. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:43:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:43:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:43:50 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f90dd-43b1-4f5a-a6d8-8791f7049b48]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:43:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:43:50 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f Jul 01 06:43:50 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:43:51 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Jul 01 06:43:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" returned: 0 in 1.768s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:43:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.821s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:43:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a20eb20-ed8b-4f6d-8523-f369c8c97608', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:43:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-ed5404f9-650a-448b-aae5-3a549d3ba0f5 req-1bd91d8d-59d0-4982-b5e4-6983b649d36e tempest-ServerActionsTestOtherA-822627629 None] attachment_update completed successfully. Jul 01 06:44:02 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:44:02 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Flow 'volume_create_manager' (3a83c832-b63b-45bb-b59d-942ef12fb199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312e285f-5810-4f5a-ad20-7d9dfd237ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312e285f-5810-4f5a-ad20-7d9dfd237ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-145787419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d228b602-17f2-42e9-b2e2-2efc180220d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326bd1c617794ff9886bfe26b7bdac41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:18Z,use_quota=True,user_id='f1c53018fce14699914f7730c1a1b56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cb002a-7d76-4773-921b-629200b59736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cb002a-7d76-4773-921b-629200b59736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8678d941-300d-41b5-a540-f64e54c526ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8678d941-300d-41b5-a540-f64e54c526ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd228b602-17f2-42e9-b2e2-2efc180220d8', 'volume_name': 'volume-d228b602-17f2-42e9-b2e2-2efc180220d8', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda0eb0f-957a-4804-8620-bd2cdf785fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda0eb0f-957a-4804-8620-bd2cdf785fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2395db-2a7f-4ed8-a8f7-28457f820c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Volume d228b602-17f2-42e9-b2e2-2efc180220d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d228b602-17f2-42e9-b2e2-2efc180220d8', 'volume_size': 1} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-145787419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d228b602-17f2-42e9-b2e2-2efc180220d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326bd1c617794ff9886bfe26b7bdac41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:18Z,use_quota=True,user_id='f1c53018fce14699914f7730c1a1b56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Creating volume d228b602-17f2-42e9-b2e2-2efc180220d8 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:44:18 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:18 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 1073741824 Jul 01 06:44:18 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Flow 'volume_create_manager' (aafef292-755c-4393-9a85-783699c97f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42797002-f531-45ab-a6a2-437b27be1263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42797002-f531-45ab-a6a2-437b27be1263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-624779921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3938a7fd-9434-47f6-a5ca-5581ba3f23a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cee47b791d4be081e92dfca7bd4ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:18Z,use_quota=True,user_id='a956a081a55944d69781d3aa3038994c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a1c43d-4224-4c43-93a0-6e0cee30377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a1c43d-4224-4c43-93a0-6e0cee30377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd76185-33a4-4b37-93e8-e680d472d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd76185-33a4-4b37-93e8-e680d472d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3938a7fd-9434-47f6-a5ca-5581ba3f23a2', 'volume_name': 'volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f74887e-8b70-45c2-bf3c-3299f585aa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f74887e-8b70-45c2-bf3c-3299f585aa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331b8ba9-8e62-49fc-98d8-03c490274358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:18 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Volume 3938a7fd-9434-47f6-a5ca-5581ba3f23a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2', 'volume_size': 1} Jul 01 06:44:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:19 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 1073741824" returned: 0 in 1.494s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:19 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 Jul 01 06:44:19 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:20 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8" returned: 0 in 0.704s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-624779921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3938a7fd-9434-47f6-a5ca-5581ba3f23a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cee47b791d4be081e92dfca7bd4ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:18Z,use_quota=True,user_id='a956a081a55944d69781d3aa3038994c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Creating volume 3938a7fd-9434-47f6-a5ca-5581ba3f23a2 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:44:20 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2395db-2a7f-4ed8-a8f7-28457f820c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d228b602-17f2-42e9-b2e2-2efc180220d8', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:20 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 1073741824 Jul 01 06:44:20 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc196c14-af81-4b62-89a1-fb196bbee647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:20 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Volume volume-d228b602-17f2-42e9-b2e2-2efc180220d8 (d228b602-17f2-42e9-b2e2-2efc180220d8): created successfully Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc196c14-af81-4b62-89a1-fb196bbee647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Flow 'volume_create_manager' (3a83c832-b63b-45bb-b59d-942ef12fb199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5a86bc5d-044c-4fff-bf61-a94ed37d0891 tempest-ServersNegativeTestJSON-1635115248 None] Created volume successfully. Jul 01 06:44:21 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 1073741824" returned: 0 in 1.250s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:21 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 Jul 01 06:44:21 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:22 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" returned: 0 in 1.134s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.442s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331b8ba9-8e62-49fc-98d8-03c490274358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eacdb30-a477-45e9-8b40-58f11afef87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:22 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Volume volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 (3938a7fd-9434-47f6-a5ca-5581ba3f23a2): created successfully Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eacdb30-a477-45e9-8b40-58f11afef87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Flow 'volume_create_manager' (aafef292-755c-4393-9a85-783699c97f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-26ca992f-5688-4ac0-8098-507816653813 tempest-AttachVolumeNegativeTest-757293942 None] Created volume successfully. Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Flow 'volume_create_manager' (56630d14-fcf0-4dfb-b905-a27c5b23db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fab38f4-525a-48bc-aa1b-b800ca5c886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fab38f4-525a-48bc-aa1b-b800ca5c886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1500904740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250a1e5b-fd4e-447e-ba3b-6c590859543d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326bd1c617794ff9886bfe26b7bdac41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:23Z,use_quota=True,user_id='f1c53018fce14699914f7730c1a1b56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba589a2-5152-4482-a20c-7a7e0ddef080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba589a2-5152-4482-a20c-7a7e0ddef080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1bb421-732d-42bd-8852-5d505df8e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1bb421-732d-42bd-8852-5d505df8e710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250a1e5b-fd4e-447e-ba3b-6c590859543d', 'volume_name': 'volume-250a1e5b-fd4e-447e-ba3b-6c590859543d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d83cb48-4920-4235-ba07-1c5782d9d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d83cb48-4920-4235-ba07-1c5782d9d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a354d12-2882-41fc-80e5-266a8de31c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:23 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Volume 250a1e5b-fd4e-447e-ba3b-6c590859543d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250a1e5b-fd4e-447e-ba3b-6c590859543d', 'volume_size': 1} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1500904740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250a1e5b-fd4e-447e-ba3b-6c590859543d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326bd1c617794ff9886bfe26b7bdac41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:23Z,use_quota=True,user_id='f1c53018fce14699914f7730c1a1b56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Creating volume 250a1e5b-fd4e-447e-ba3b-6c590859543d {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:44:23 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:44:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:23 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d 1073741824 Jul 01 06:44:23 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:25 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d 1073741824" returned: 0 in 1.521s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:25 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d Jul 01 06:44:25 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:25 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d" returned: 0 in 0.713s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a354d12-2882-41fc-80e5-266a8de31c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250a1e5b-fd4e-447e-ba3b-6c590859543d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e418cbb4-d313-4a4f-8bd7-854390d31a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:25 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Volume volume-250a1e5b-fd4e-447e-ba3b-6c590859543d (250a1e5b-fd4e-447e-ba3b-6c590859543d): created successfully Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e418cbb4-d313-4a4f-8bd7-854390d31a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Flow 'volume_create_manager' (56630d14-fcf0-4dfb-b905-a27c5b23db9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3392758d-65be-4020-9771-ba6e7d36673a tempest-ServersNegativeTestJSON-1635115248 None] Created volume successfully. Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:26 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:44:26 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b609f72e-f97a-4735-a87f-8c7736f3acae]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:27 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.381s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 8 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:44:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:44:28 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 Jul 01 06:44:28 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "cinder-250a1e5b-fd4e-447e-ba3b-6c590859543d-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-250a1e5b-fd4e-447e-ba3b-6c590859543d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "cinder-quobyte-250a1e5b-fd4e-447e-ba3b-6c590859543d" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-quobyte-250a1e5b-fd4e-447e-ba3b-6c590859543d" acquired by "delete_volume" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0390a86c-0db6-4ea9-bf62-53bf9a70cf1e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:44:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:28 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d Jul 01 06:44:28 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:29 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" returned: 0 in 1.410s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.461s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ea8aee4-2765-4b82-a0e1-6f9da7dfc4d7', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:44:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-c85bccd5-faaf-495d-8916-6232b497be7b tempest-AttachVolumeNegativeTest-757293942 None] attachment_update completed successfully. Jul 01 06:44:29 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d" returned: 0 in 1.124s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:29 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d Jul 01 06:44:29 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-ae82169e-508c-48f1-b147-94dda1962718 req-a1a0a48a-5ca5-418c-8e78-5f9f5e6ea27b tempest-ServerActionsTestOtherA-822627629 None] Terminate volume connection completed successfully. Jul 01 06:44:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-ae82169e-508c-48f1-b147-94dda1962718 req-a1a0a48a-5ca5-418c-8e78-5f9f5e6ea27b tempest-ServerActionsTestOtherA-822627629 None] Deleting attachment 5a20eb20-ed8b-4f6d-8523-f369c8c97608. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:44:30 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-250a1e5b-fd4e-447e-ba3b-6c590859543d" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-quobyte-250a1e5b-fd4e-447e-ba3b-6c590859543d" released by "delete_volume" :: held 1.941s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Created reservations ['ec615274-4703-4003-9fd9-60001bca3a42', 'ae19d7c5-be03-411c-bd97-d887bd1fba4a', '3d08ef56-c6b1-44dd-bc1b-d13c66ae486e', '969d9e24-b8b4-4668-b00e-10bd605e918c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:44:30 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-46ca0dd4-1d9f-4815-ab65-e1729a2ab875 tempest-AttachVolumeNegativeTest-757293942 None] Terminate volume connection completed successfully. Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-3976ead8-3eab-4315-a2e9-dd039bd7d388 req-46ca0dd4-1d9f-4815-ab65-e1729a2ab875 tempest-AttachVolumeNegativeTest-757293942 None] Deleting attachment 1ea8aee4-2765-4b82-a0e1-6f9da7dfc4d7. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:30 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:44:30 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "cinder-d228b602-17f2-42e9-b2e2-2efc180220d8-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-d228b602-17f2-42e9-b2e2-2efc180220d8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "cinder-quobyte-d228b602-17f2-42e9-b2e2-2efc180220d8" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-quobyte-d228b602-17f2-42e9-b2e2-2efc180220d8" acquired by "delete_volume" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81fe1a5-b0e7-4c28-8d6f-b3b312ec3e46]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:44:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:31 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 Jul 01 06:44:31 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:31 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.835s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:31 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:44:31 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Deleted volume successfully. Jul 01 06:44:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-972d9fa5-568c-413b-b97e-6f4d6ab300ee tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-250a1e5b-fd4e-447e-ba3b-6c590859543d-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:44:31 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8" returned: 0 in 0.819s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:31 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8 Jul 01 06:44:31 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:32 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d228b602-17f2-42e9-b2e2-2efc180220d8" returned: 0 in 0.685s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-quobyte-d228b602-17f2-42e9-b2e2-2efc180220d8" released by "delete_volume" :: held 1.566s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Created reservations ['b7cebe79-513a-43a9-9952-63b9f78307dc', 'cbe42c4c-bb15-4920-8752-4158362891e4', 'f654c18e-406a-4ff0-b462-0d09c32dbe61', '7fc62c47-bb7d-4626-aaa3-b92e9a1254ec'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:32 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:44:32 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:33 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.190s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:33 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:44:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Deleted volume successfully. Jul 01 06:44:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-86755aad-e3f4-40d7-94c2-850a61daea3f tempest-ServersNegativeTestJSON-1635115248 None] Lock "cinder-d228b602-17f2-42e9-b2e2-2efc180220d8-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:44:36 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:44:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Flow 'volume_create_manager' (996737de-c1ea-4400-88ac-a50b37e27bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1a39fb-43ab-47a0-96e4-445e9a27b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1a39fb-43ab-47a0-96e4-445e9a27b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-568755551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8712c35d07f04cb99ddda79d1b315e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:37Z,use_quota=True,user_id='0435441a822648f0913233af92db5068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e59009-f97a-43ae-9914-4423980ccb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e59009-f97a-43ae-9914-4423980ccb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef160ab-4836-4472-9f60-2078715ebe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef160ab-4836-4472-9f60-2078715ebe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4', 'volume_name': 'volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552c92d4-18af-4936-81a6-d86e57297065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552c92d4-18af-4936-81a6-d86e57297065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c8deb4-417b-4d83-855f-bf351e013bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:37 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Volume b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4', 'volume_size': 1} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-568755551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8712c35d07f04cb99ddda79d1b315e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:37Z,use_quota=True,user_id='0435441a822648f0913233af92db5068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Creating volume b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:44:37 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:44:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:37 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 1073741824 Jul 01 06:44:37 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:38 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 1073741824" returned: 0 in 1.236s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:38 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 Jul 01 06:44:38 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:39 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4" returned: 0 in 1.025s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c8deb4-417b-4d83-855f-bf351e013bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68549c7b-28cf-4511-864a-c5c6b42af0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:39 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Volume volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 (b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4): created successfully Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68549c7b-28cf-4511-864a-c5c6b42af0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Flow 'volume_create_manager' (996737de-c1ea-4400-88ac-a50b37e27bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:39 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3d5cf070-45ed-4a0a-9f41-e110fb45d429 tempest-ServerRescueNegativeTestJSON-1197834872 None] Created volume successfully. Jul 01 06:44:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "cinder-a3d8b74f-d807-43aa-9566-b4920fbbbb4f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Lock "cinder-a3d8b74f-d807-43aa-9566-b4920fbbbb4f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "cinder-quobyte-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Lock "cinder-quobyte-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[278c5afb-0e44-4e98-9705-689756eceede]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:44:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:44 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f Jul 01 06:44:44 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:46 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" returned: 0 in 1.183s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:46 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f Jul 01 06:44:46 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:47 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" returned: 0 in 1.004s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Lock "cinder-quobyte-a3d8b74f-d807-43aa-9566-b4920fbbbb4f" released by "delete_volume" :: held 2.255s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Created reservations ['3f1bd7fe-620f-4a71-89c9-68e7a49f61ef', 'ef4718c2-a944-4e7d-a8c3-0e1a305a72c3', 'e57b9483-3236-402b-aed5-26f8472f5643', '95916084-cbf8-4dc0-b3dc-57be6c5074c1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:47 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:44:47 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:48 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.837s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:48 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:44:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Deleted volume successfully. Jul 01 06:44:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-de8d406c-6985-4462-9ebc-a17d6f9b29eb tempest-ServerActionsTestOtherA-822627629 None] Lock "cinder-a3d8b74f-d807-43aa-9566-b4920fbbbb4f-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Flow 'volume_create_manager' (cec537e7-f657-40e0-b64c-32827ae01cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7379e54a-2a84-422f-b4f5-7d080da814a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7379e54a-2a84-422f-b4f5-7d080da814a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1783922072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294a1b01-19e9-4197-b36c-ba87355b9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ec5e239a864ed688047d952e6bc1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:51Z,use_quota=True,user_id='b29d5de499f64e05940e83b40e3d186f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5967965-8d01-48c3-95b2-368a1790f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5967965-8d01-48c3-95b2-368a1790f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b032e260-5f85-49ab-8e9c-1bf1084538bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b032e260-5f85-49ab-8e9c-1bf1084538bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294a1b01-19e9-4197-b36c-ba87355b9d8a', 'volume_name': 'volume-294a1b01-19e9-4197-b36c-ba87355b9d8a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54aeb891-f054-42d7-8c1b-8b75d831bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54aeb891-f054-42d7-8c1b-8b75d831bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9772ba-9c75-46e1-8dc5-aa4862d55eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Volume 294a1b01-19e9-4197-b36c-ba87355b9d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294a1b01-19e9-4197-b36c-ba87355b9d8a', 'volume_size': 1} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1783922072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294a1b01-19e9-4197-b36c-ba87355b9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ec5e239a864ed688047d952e6bc1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:44:51Z,use_quota=True,user_id='b29d5de499f64e05940e83b40e3d186f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Creating volume 294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:44:51 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:44:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:51 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a 1073741824 Jul 01 06:44:51 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:52 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a 1073741824" returned: 0 in 1.318s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:52 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a Jul 01 06:44:52 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:53 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a" returned: 0 in 0.729s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9772ba-9c75-46e1-8dc5-aa4862d55eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294a1b01-19e9-4197-b36c-ba87355b9d8a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2050bf1c-f3ff-4002-9f46-01af6a5b2d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:44:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Volume volume-294a1b01-19e9-4197-b36c-ba87355b9d8a (294a1b01-19e9-4197-b36c-ba87355b9d8a): created successfully Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2050bf1c-f3ff-4002-9f46-01af6a5b2d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:44:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Flow 'volume_create_manager' (cec537e7-f657-40e0-b64c-32827ae01cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:44:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-29b0576e-cdc0-492a-b4e3-4c1412d68e47 req-132cb24c-5b75-4a08-a7d1-64e9bb681def tempest-VolumesSnapshotsTestJSON-948506853 None] Created volume successfully. Jul 01 06:44:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:44:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:44:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Creating offline snapshot 33c7acb8-cfb2-48dc-97b3-83d986ba9622 of volume 294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:44:55 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3786c8d-309a-4183-b87b-8446ddfb588d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:44:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:55 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a Jul 01 06:44:55 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:56 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a" returned: 0 in 1.338s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:56 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 1G Jul 01 06:44:56 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:57 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 1G" returned: 0 in 1.162s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294a1b01-19e9-4197-b36c-ba87355b9d8a -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:57 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294a1b01-19e9-4197-b36c-ba87355b9d8a -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 Jul 01 06:44:57 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:58 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294a1b01-19e9-4197-b36c-ba87355b9d8a -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622" returned: 0 in 0.874s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:58 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 is being set with open permissions: ugo+rw Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:58 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 Jul 01 06:44:58 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Acquiring lock "cinder-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "cinder-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Acquiring lock "cinder-quobyte-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "cinder-quobyte-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4" acquired by "delete_volume" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0445480a-a4ce-4625-a716-f7bee58e8d70]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:44:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:58 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 Jul 01 06:44:58 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:59 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622" returned: 0 in 0.940s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:59 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info Jul 01 06:44:59 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:44:59 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 01 06:44:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4" returned: 0 in 1.138s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:44:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:44:59 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4 Jul 01 06:44:59 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:00 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info" returned: 0 in 0.836s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:00 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info is being set with open permissions: ugo+rw Jul 01 06:45:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:00 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info Jul 01 06:45:00 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:00 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4" returned: 0 in 0.916s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "cinder-quobyte-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4" released by "delete_volume" :: held 2.146s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:00 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Created reservations ['311e848d-ed69-41f4-a512-876e351f7287', 'b2741ce5-5f9a-426c-b996-c7e320d445fc', '000f1c75-93ce-429e-a232-d021a80b1d97', 'f948b9e3-3d83-4019-a457-9a16e185a2a7'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:01 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.info" returned: 0 in 0.835s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:01 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:45:01 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.175s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-d22c12ad-c72c-4b2f-bec3-8c9c12758774 req-4ecdd7d5-af17-4762-b084-f96e2a24f152 tempest-VolumesSnapshotsTestJSON-948506853 None] Create snapshot completed successfully Jul 01 06:45:01 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.858s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:45:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Deleted volume successfully. Jul 01 06:45:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a979728-03b5-4180-9d15-ed5294472abc tempest-ServerRescueNegativeTestJSON-1197834872 None] Lock "cinder-b1e654c5-4dfe-4bdb-acee-4a7cbdd44ff4-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "cinder-33c7acb8-cfb2-48dc-97b3-83d986ba9622-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-33c7acb8-cfb2-48dc-97b3-83d986ba9622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "cinder-quobyte-294a1b01-19e9-4197-b36c-ba87355b9d8a" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-quobyte-294a1b01-19e9-4197-b36c-ba87355b9d8a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "cinder-quobyte-33c7acb8-cfb2-48dc-97b3-83d986ba9622" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-quobyte-33c7acb8-cfb2-48dc-97b3-83d986ba9622" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Deleting offline snapshot 33c7acb8-cfb2-48dc-97b3-83d986ba9622 of volume 294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] snapshot_file for this snap is: volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c8048-870c-4590-a994-de3506a0a843]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:02 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 Jul 01 06:45:02 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:03 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622" returned: 0 in 1.301s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294a1b01-19e9-4197-b36c-ba87355b9d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:45:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ced3f00-53bf-4169-973b-28151cad5354]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:03 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a Jul 01 06:45:03 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:05 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a" returned: 0 in 1.253s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:05 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 Jul 01 06:45:05 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:06 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622" returned: 0 in 1.131s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:06 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622 Jul 01 06:45:06 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:06 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a.33c7acb8-cfb2-48dc-97b3-83d986ba9622" returned: 0 in 0.743s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-quobyte-33c7acb8-cfb2-48dc-97b3-83d986ba9622" released by "_delete_snapshot" :: held 4.593s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-quobyte-294a1b01-19e9-4197-b36c-ba87355b9d8a" released by "delete_snapshot" :: held 4.645s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:07 devstack cinder-volume[86219]: WARNING cinder.quota [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:07 devstack cinder-volume[86219]: DEBUG cinder.quota [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Created reservations ['72c95bf8-7990-4709-9bdf-d2390681e3c2', '036ce95a-8597-44bb-b3dc-bf19c30b13ed', '7ccda041-3a68-4bab-8f2d-efd593e88d06', 'c5f08b05-2f4e-460c-9187-78bc3bd31ff7'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Delete snapshot completed successfully. Jul 01 06:45:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78abb3a1-a183-418a-a072-dedc4bbb674a req-30ed129d-2b6b-4a11-8016-532a2a9933d5 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-33c7acb8-cfb2-48dc-97b3-83d986ba9622-delete_snapshot" released by "delete_snapshot" :: held 4.850s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "cinder-294a1b01-19e9-4197-b36c-ba87355b9d8a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-294a1b01-19e9-4197-b36c-ba87355b9d8a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "cinder-quobyte-294a1b01-19e9-4197-b36c-ba87355b9d8a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-quobyte-294a1b01-19e9-4197-b36c-ba87355b9d8a" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01a1024-f698-4ab0-a2fa-257babd379dd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:08 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a Jul 01 06:45:08 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:09 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a" returned: 0 in 1.031s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:09 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a Jul 01 06:45:09 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:09 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-294a1b01-19e9-4197-b36c-ba87355b9d8a" returned: 0 in 0.674s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-quobyte-294a1b01-19e9-4197-b36c-ba87355b9d8a" released by "delete_volume" :: held 1.796s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG cinder.quota [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Created reservations ['b4a71791-3f44-4859-b8ed-042fa0c37f23', '70f31654-78a1-484e-a5b9-10755bc60272', '0d973078-a5b1-4bf3-aa93-f04a93b8293a', 'ba018ad8-3b23-41b0-adae-7f4b61527bec'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:10 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:45:10 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:10 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.793s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG cinder.manager [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:45:10 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Deleted volume successfully. Jul 01 06:45:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-b74a374d-3f84-4108-ab4a-5b32ce137d32 req-7a8d9deb-85ef-4da0-b8c6-9f57ac2ab7b4 tempest-VolumesSnapshotsTestJSON-948506853 None] Lock "cinder-294a1b01-19e9-4197-b36c-ba87355b9d8a-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-47fd931a-2cf9-4839-bf40-ef2dc4a4c3c0 tempest-BackendsCapabilitiesAdminTestsJSON-260165076 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86219) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 01 06:45:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-754d8348-a28b-42bc-bcf0-24fbf2e0fb90 tempest-BackendsCapabilitiesAdminTestsJSON-260165076 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86219) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 01 06:45:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=48,cinder:UPDATE=59,cinder:DELETE=7,cinder:INSERT=15 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:45:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9bafc67-9f30-40f8-aa04-42a2db875310 tempest-GroupSnapshotsV319Test-970783088 None] Group tempest-GroupSnapshotsV319Test-Group-1003130466: creating Jul 01 06:45:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=58,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:45:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9bafc67-9f30-40f8-aa04-42a2db875310 tempest-GroupSnapshotsV319Test-970783088 None] Group tempest-GroupSnapshotsV319Test-Group-1003130466: created successfully Jul 01 06:45:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9bafc67-9f30-40f8-aa04-42a2db875310 tempest-GroupSnapshotsV319Test-970783088 None] Create group completed successfully. Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Flow 'volume_create_manager' (5acccfb9-20a8-4eae-872f-5af92c578d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253b1a1e-22dc-48d5-a867-5c6df60a1d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253b1a1e-22dc-48d5-a867-5c6df60a1d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004218222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0cd26f8-65ce-4a20-a5cc-dc62ef800dfa,host='devstack@QuobyteHD#QuobyteHD',id=846a8b8e-66f2-43b5-a884-96216be2e7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f9c53acfe1428dac283a734420a490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:18Z,use_quota=True,user_id='5288ff6904444b9e9eb58a8ef556399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f77ae8-b1f4-49d8-bd7a-3bf2bafb80f0),volume_type_id=a9f77ae8-b1f4-49d8-bd7a-3bf2bafb80f0)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bec16a5-83e8-4376-9b7e-65d7302e6c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bec16a5-83e8-4376-9b7e-65d7302e6c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e704ae93-64b7-460d-a964-4f99ee575694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e704ae93-64b7-460d-a964-4f99ee575694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846a8b8e-66f2-43b5-a884-96216be2e7c0', 'volume_name': 'volume-846a8b8e-66f2-43b5-a884-96216be2e7c0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80056282-880a-4cf5-904c-919a743680ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80056282-880a-4cf5-904c-919a743680ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65758b8-3689-4b7e-89a1-d4700d0f8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Volume 846a8b8e-66f2-43b5-a884-96216be2e7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846a8b8e-66f2-43b5-a884-96216be2e7c0', 'volume_size': 1} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0cd26f8-65ce-4a20-a5cc-dc62ef800dfa,created_at=2026-07-01T04:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004218222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0cd26f8-65ce-4a20-a5cc-dc62ef800dfa,host='devstack@QuobyteHD#QuobyteHD',id=846a8b8e-66f2-43b5-a884-96216be2e7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f9c53acfe1428dac283a734420a490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:18Z,use_quota=True,user_id='5288ff6904444b9e9eb58a8ef556399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f77ae8-b1f4-49d8-bd7a-3bf2bafb80f0),volume_type_id=a9f77ae8-b1f4-49d8-bd7a-3bf2bafb80f0)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Creating volume 846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:45:17 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:45:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:17 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 1073741824 Jul 01 06:45:17 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-50274939-03d0-46a0-96eb-4f79de86fe7f tempest-GroupSnapshotsTest-1674439300 None] Group tempest-GroupSnapshotsTest-Group-333788050: creating Jul 01 06:45:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-50274939-03d0-46a0-96eb-4f79de86fe7f tempest-GroupSnapshotsTest-1674439300 None] Group tempest-GroupSnapshotsTest-Group-333788050: created successfully Jul 01 06:45:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-50274939-03d0-46a0-96eb-4f79de86fe7f tempest-GroupSnapshotsTest-1674439300 None] Create group completed successfully. Jul 01 06:45:18 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 1073741824" returned: 0 in 0.953s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:18 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 Jul 01 06:45:18 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:19 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0" returned: 0 in 0.722s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65758b8-3689-4b7e-89a1-d4700d0f8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846a8b8e-66f2-43b5-a884-96216be2e7c0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d3a9bb-fe2c-4f27-9352-842dac2a9db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Volume volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 (846a8b8e-66f2-43b5-a884-96216be2e7c0): created successfully Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d3a9bb-fe2c-4f27-9352-842dac2a9db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Flow 'volume_create_manager' (5acccfb9-20a8-4eae-872f-5af92c578d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8e130ac5-b6e5-4162-a4e1-457b77d499d4 tempest-GroupSnapshotsV319Test-970783088 None] Created volume successfully. Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (0eb7567e-7207-4c72-a5c2-9796e08d6977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29676cd2-6721-4ff0-ab7c-89e47d271bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29676cd2-6721-4ff0-ab7c-89e47d271bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331893759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa161ca4-dab3-45d1-8585-122c6614bd2d,host='devstack@QuobyteHD#QuobyteHD',id=96d8e93b-f739-4700-b8e8-c271f0cf74c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:20Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6fc7d93-a3a8-444c-aec2-ed31d9afdf6d),volume_type_id=d6fc7d93-a3a8-444c-aec2-ed31d9afdf6d)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041a0407-fca0-4161-a056-cfad430339d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041a0407-fca0-4161-a056-cfad430339d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d9fb78-cbbd-426f-a123-01f9d8371d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d9fb78-cbbd-426f-a123-01f9d8371d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d8e93b-f739-4700-b8e8-c271f0cf74c8', 'volume_name': 'volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6a7a60-0bf4-4c26-874e-c82c272fc68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6a7a60-0bf4-4c26-874e-c82c272fc68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a78b6e-5712-4d76-b935-d99c8e2a07dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:20 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Volume 96d8e93b-f739-4700-b8e8-c271f0cf74c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8', 'volume_size': 1} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa161ca4-dab3-45d1-8585-122c6614bd2d,created_at=2026-07-01T04:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331893759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa161ca4-dab3-45d1-8585-122c6614bd2d,host='devstack@QuobyteHD#QuobyteHD',id=96d8e93b-f739-4700-b8e8-c271f0cf74c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:20Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6fc7d93-a3a8-444c-aec2-ed31d9afdf6d),volume_type_id=d6fc7d93-a3a8-444c-aec2-ed31d9afdf6d)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Creating volume 96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:45:20 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:20 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 1073741824 Jul 01 06:45:20 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] GroupSnapshot 0a6841bb-babc-4794-a584-88ffe9c401d3: creating. Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Group snapshot 0a6841bb-babc-4794-a584-88ffe9c401d3: creating. {{(pid=86219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 06:45:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:21 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 1073741824" returned: 0 in 0.969s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:21 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:21 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:22 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 0.746s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.504s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Creating offline snapshot 11b8d878-5508-4e69-94e1-35b3d4a1324e of volume 846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a78b6e-5712-4d76-b935-d99c8e2a07dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08b6398-650a-4132-902c-11772507d9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a827618-6529-449b-a7dd-0cd06d6b02ad]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:22 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Volume volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 (96d8e93b-f739-4700-b8e8-c271f0cf74c8): created successfully Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08b6398-650a-4132-902c-11772507d9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (0eb7567e-7207-4c72-a5c2-9796e08d6977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c35a4d3b-3ccd-4c79-87af-38b484a251ac tempest-GroupSnapshotsTest-1674439300 None] Created volume successfully. Jul 01 06:45:22 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 Jul 01 06:45:22 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:23 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] GroupSnapshot 9083416e-5c15-4cac-a263-5e419f7442d0: creating. Jul 01 06:45:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Group snapshot 9083416e-5c15-4cac-a263-5e419f7442d0: creating. {{(pid=86219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 06:45:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:23 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0" returned: 0 in 0.913s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:23 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e 1G Jul 01 06:45:23 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:23 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e 1G" returned: 0 in 0.817s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:23 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e Jul 01 06:45:23 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:24 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:24 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:45:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:24 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e Jul 01 06:45:24 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:25 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e" returned: 0 in 0.742s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:25 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info Jul 01 06:45:25 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:26 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info" returned: 0 in 0.672s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:26 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:26 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info Jul 01 06:45:26 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:26 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:45:26 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:26 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.info" returned: 0 in 0.645s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.727s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Creating offline snapshot 0a709672-9665-445e-8649-3e52b49c66fa of volume 96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[173bfbe1-3a43-44b1-b29d-a2a2a1d11f8a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c6275f6f-7103-4add-99c4-11dcc6ea9fcb tempest-GroupSnapshotsV319Test-970783088 None] group_snapshot 0a6841bb-babc-4794-a584-88ffe9c401d3: created successfully Jul 01 06:45:27 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:27 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:27 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.720s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:45:27 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 0.903s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:27 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa 1G Jul 01 06:45:27 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:28 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] group_snapshot 0a6841bb-babc-4794-a584-88ffe9c401d3: deleting Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] group_snapshot 0a6841bb-babc-4794-a584-88ffe9c401d3: deleting {{(pid=86219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "cinder-quobyte-846a8b8e-66f2-43b5-a884-96216be2e7c0" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Lock "cinder-quobyte-846a8b8e-66f2-43b5-a884-96216be2e7c0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "cinder-quobyte-11b8d878-5508-4e69-94e1-35b3d4a1324e" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Lock "cinder-quobyte-11b8d878-5508-4e69-94e1-35b3d4a1324e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Deleting offline snapshot 11b8d878-5508-4e69-94e1-35b3d4a1324e of volume 846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] snapshot_file for this snap is: volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e7450-d938-4fac-8b7b-e2d9f9a76e81]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:28 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e Jul 01 06:45:28 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:28 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa 1G" returned: 0 in 1.153s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:28 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa Jul 01 06:45:28 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:29 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e" returned: 0 in 0.995s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-846a8b8e-66f2-43b5-a884-96216be2e7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:45:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b008f20-fa32-4c84-b5c1-8c7d52e7d142]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:29 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa" returned: 0 in 0.900s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:29 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:45:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:29 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa Jul 01 06:45:29 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:29 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 Jul 01 06:45:29 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:30 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa" returned: 0 in 0.807s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:30 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info Jul 01 06:45:30 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:30 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0" returned: 0 in 0.946s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:30 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e Jul 01 06:45:30 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:31 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info" returned: 0 in 0.694s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:31 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:45:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:31 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info Jul 01 06:45:31 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:31 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e" returned: 0 in 0.848s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:31 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e Jul 01 06:45:31 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:32 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.info" returned: 0 in 0.741s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.320s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a750dc9b-b556-4de5-8d42-ce241f45fd9a tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9083416e-5c15-4cac-a263-5e419f7442d0: created successfully Jul 01 06:45:32 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0.11b8d878-5508-4e69-94e1-35b3d4a1324e" returned: 0 in 0.692s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Lock "cinder-quobyte-11b8d878-5508-4e69-94e1-35b3d4a1324e" released by "_delete_snapshot" :: held 3.623s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Lock "cinder-quobyte-846a8b8e-66f2-43b5-a884-96216be2e7c0" released by "delete_snapshot" :: held 3.649s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:32 devstack cinder-volume[86219]: WARNING cinder.quota [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1141312971 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1141312971, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:32 devstack cinder-volume[86219]: WARNING cinder.quota [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1141312971 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1141312971, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] Created reservations ['6a99cc22-35d5-4f58-86c5-dc5bac25f4f0', '0fa4bdf9-e01c-4ac6-9fab-417a4c18bb5c', 'f88ee245-26f7-4607-aeb1-37609b3febd9', '6ff944f4-7b10-467e-8974-f1cd8258f2de'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3cbbaa6b-fb64-4975-8640-819907a92145 tempest-GroupSnapshotsV319Test-970783088 None] group_snapshot 0a6841bb-babc-4794-a584-88ffe9c401d3: deleted successfully Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "cinder-quobyte-846a8b8e-66f2-43b5-a884-96216be2e7c0" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Lock "cinder-quobyte-846a8b8e-66f2-43b5-a884-96216be2e7c0" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b1d449-2719-4b48-9973-486570bd6262]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-0a709672-9665-445e-8649-3e52b49c66fa-c06d7f96-2475-44cb-b15d-cd9910f1a16b" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-0a709672-9665-445e-8649-3e52b49c66fa-c06d7f96-2475-44cb-b15d-cd9910f1a16b" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Creating volume c06d7f96-2475-44cb-b15d-cd9910f1a16b from snapshot 0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-c06d7f96-2475-44cb-b15d-cd9910f1a16b" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:33 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 Jul 01 06:45:33 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-c06d7f96-2475-44cb-b15d-cd9910f1a16b" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] snapshot: 0a709672-9665-445e-8649-3e52b49c66fa, volume: c06d7f96-2475-44cb-b15d-cd9910f1a16b, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[092bd034-898e-409e-8040-501a7030614a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:34 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa Jul 01 06:45:34 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:34 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0" returned: 0 in 0.902s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:34 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0 Jul 01 06:45:34 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:34 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa" returned: 0 in 0.926s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef180c6a-a7a0-48de-b904-7e7137e23ff3]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:35 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:35 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:35 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-846a8b8e-66f2-43b5-a884-96216be2e7c0" returned: 0 in 0.864s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Lock "cinder-quobyte-846a8b8e-66f2-43b5-a884-96216be2e7c0" released by "delete_volume" :: held 1.876s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Created reservations ['d691def7-686e-4df3-8fd3-9948064bf73a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:35 devstack cinder-volume[86219]: WARNING cinder.quota [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1141312971 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1141312971, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Created reservations ['685a3825-2748-4076-80b9-87c7ece56e02', '29b45b2f-a811-41a1-a15d-2827a2323d0d', '3836c943-5234-463a-a254-3cbe8141c1a4', '9a0f908f-3426-4bb0-8b8b-4e3b8d97aa68'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:35 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:45:35 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:35 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 0.997s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:45:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:36 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b Jul 01 06:45:36 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:36 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.717s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:36 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:45:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-58503a5d-fd29-42be-b46f-f6eee66c9a22 tempest-GroupSnapshotsV319Test-970783088 None] Delete group completed successfully. Jul 01 06:45:42 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b" returned: 0 in 6.342s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e4e74-295a-46d8-80b2-be36b24bf0e4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:42 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:42 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:43 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 1.042s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:43 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:45:43 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Converted 1024.00 MB image at 161.45 MB/s Jul 01 06:45:43 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:45:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:43 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b Jul 01 06:45:43 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:44 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-c06d7f96-2475-44cb-b15d-cd9910f1a16b" released by "_copy_volume_from_snapshot" :: held 10.170s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-0a709672-9665-445e-8649-3e52b49c66fa-c06d7f96-2475-44cb-b15d-cd9910f1a16b" released by "_create_volume_from_snapshot" :: held 10.228s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.260s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c0a007d6-d10b-4993-b63b-fd33b3668450 tempest-GroupSnapshotsTest-1674439300 None] Create group from source-snapshot-9083416e-5c15-4cac-a263-5e419f7442d0 completed successfully. Jul 01 06:45:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-c06d7f96-2475-44cb-b15d-cd9910f1a16b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-c06d7f96-2475-44cb-b15d-cd9910f1a16b" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:45 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58a6032-6c8a-4761-b4ff-edf7451774c1]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:45 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b Jul 01 06:45:45 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:46 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b" returned: 0 in 0.862s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:46 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b Jul 01 06:45:46 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:46 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c06d7f96-2475-44cb-b15d-cd9910f1a16b" returned: 0 in 0.686s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-c06d7f96-2475-44cb-b15d-cd9910f1a16b" released by "delete_volume" :: held 1.609s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['dd5f95d3-fc0b-4eaa-8927-dab74664318b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:46 devstack cinder-volume[86219]: WARNING cinder.quota [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1901489569 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1901489569, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:46 devstack cinder-volume[86219]: WARNING cinder.quota [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1901489569 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1901489569, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['e6da99f7-9025-461c-868d-27e5bba4ed7b', 'b827316c-b107-416d-a3ef-be709823ed73', '80bf7525-8deb-4b58-ad1f-6eff88431c1d', '682aafb3-8305-4c41-89e9-92acabf58e0a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:46 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:45:46 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:47 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.658s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:45:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-975c63bd-68a4-470c-b084-1313e04559e1 tempest-GroupSnapshotsTest-1674439300 None] Delete group completed successfully. Jul 01 06:45:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9083416e-5c15-4cac-a263-5e419f7442d0: deleting Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9083416e-5c15-4cac-a263-5e419f7442d0: deleting {{(pid=86219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-96d8e93b-f739-4700-b8e8-c271f0cf74c8" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-96d8e93b-f739-4700-b8e8-c271f0cf74c8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-0a709672-9665-445e-8649-3e52b49c66fa" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-0a709672-9665-445e-8649-3e52b49c66fa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Deleting offline snapshot 0a709672-9665-445e-8649-3e52b49c66fa of volume 96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] snapshot_file for this snap is: volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c651e54-7737-47e3-820a-7f9d4016024f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:47 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa Jul 01 06:45:47 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:48 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa" returned: 0 in 0.874s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:45:48 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59095aa-17f4-4e4d-96d4-345f781208fd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:48 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:48 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:49 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 1.095s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:49 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa Jul 01 06:45:49 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:50 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa" returned: 0 in 0.939s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:50 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa Jul 01 06:45:50 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:51 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8.0a709672-9665-445e-8649-3e52b49c66fa" returned: 0 in 0.697s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-0a709672-9665-445e-8649-3e52b49c66fa" released by "_delete_snapshot" :: held 3.738s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-96d8e93b-f739-4700-b8e8-c271f0cf74c8" released by "delete_snapshot" :: held 3.769s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:51 devstack cinder-volume[86219]: WARNING cinder.quota [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1901489569 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1901489569, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:45:51 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['cc04c6f9-4933-4a59-a78e-aa324cfbdc2e', 'b48182d5-e558-4f29-ad92-500508550f33', 'b19b68c7-a715-43e6-ad93-c1801194ca04', '3779047c-f127-4751-888b-0774928971a9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-85b062e8-11cb-4a48-af54-47271f274f9e tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9083416e-5c15-4cac-a263-5e419f7442d0: deleted successfully Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Flow 'volume_create_manager' (425c44a3-d3dc-46e9-9f96-d464fb95b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7107b4-cdaa-4ac9-aa34-b10332d8953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7107b4-cdaa-4ac9-aa34-b10332d8953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-925324629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816302d-9dc1-455a-b2b9-7530b765452e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243e2db55956442fb87f18278ddbcfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:52Z,use_quota=True,user_id='aa7d26d774e643e4a502b95208017d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cb382d-bad9-4817-92bb-a1f8efab21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cb382d-bad9-4817-92bb-a1f8efab21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183c78ca-158c-4d28-a1a6-27a2bd0496b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183c78ca-158c-4d28-a1a6-27a2bd0496b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f816302d-9dc1-455a-b2b9-7530b765452e', 'volume_name': 'volume-f816302d-9dc1-455a-b2b9-7530b765452e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9ba299-fce5-4b50-8824-73add7daff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9ba299-fce5-4b50-8824-73add7daff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac17921a-5d7c-4897-b00f-aaa278da54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:52 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Volume f816302d-9dc1-455a-b2b9-7530b765452e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f816302d-9dc1-455a-b2b9-7530b765452e', 'volume_size': 1} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-925324629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816302d-9dc1-455a-b2b9-7530b765452e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243e2db55956442fb87f18278ddbcfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:52Z,use_quota=True,user_id='aa7d26d774e643e4a502b95208017d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Creating volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:45:52 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:52 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e 1073741824 Jul 01 06:45:52 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-96d8e93b-f739-4700-b8e8-c271f0cf74c8" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-96d8e93b-f739-4700-b8e8-c271f0cf74c8" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e1af48-908c-4054-a9b6-649494107bbe]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:52 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:52 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:53 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e 1073741824" returned: 0 in 0.907s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:53 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e Jul 01 06:45:53 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:53 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 0.802s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:53 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8 Jul 01 06:45:53 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:53 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e" returned: 0 in 0.648s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:45:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac17921a-5d7c-4897-b00f-aaa278da54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f816302d-9dc1-455a-b2b9-7530b765452e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6bf3d5-0004-4685-8581-0efa3ba04ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:54 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Volume volume-f816302d-9dc1-455a-b2b9-7530b765452e (f816302d-9dc1-455a-b2b9-7530b765452e): created successfully Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6bf3d5-0004-4685-8581-0efa3ba04ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Flow 'volume_create_manager' (425c44a3-d3dc-46e9-9f96-d464fb95b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1e0cb02d-2e2f-4523-b532-e7d1c23ba239 tempest-SnapshotsActionsTest-1753308732 None] Created volume successfully. Jul 01 06:45:54 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96d8e93b-f739-4700-b8e8-c271f0cf74c8" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-96d8e93b-f739-4700-b8e8-c271f0cf74c8" released by "delete_volume" :: held 1.569s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['06a8223f-1dad-4cce-9783-96ce0cd3362c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:54 devstack cinder-volume[86219]: WARNING cinder.db.api [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1901489569'] Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['cd91033d-f517-4bcd-af26-f9e531fe44f0', '7eb5b8ef-6072-41cb-8b0f-83f51016343e', '48993d8e-2b39-4765-bf17-a5c40d65cbb5', '2eb2696a-495b-4a3c-bc8f-17a01c3a99ca'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:54 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:45:54 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Creating offline snapshot ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef4257-09b4-4ff7-bcda-21f255c88c82]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:45:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:54 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e Jul 01 06:45:54 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:55 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:55 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:45:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a581c102-4945-4f81-bddf-5eb94b46dcfe tempest-GroupSnapshotsTest-1674439300 None] Delete group completed successfully. Jul 01 06:45:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9120a5a-8d09-405b-a3ff-41fe58bfc6f9 tempest-GroupSnapshotsTest-1674439300 None] Group tempest-GroupSnapshotsTest-Group-776168329: creating Jul 01 06:45:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9120a5a-8d09-405b-a3ff-41fe58bfc6f9 tempest-GroupSnapshotsTest-1674439300 None] Group tempest-GroupSnapshotsTest-Group-776168329: created successfully Jul 01 06:45:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9120a5a-8d09-405b-a3ff-41fe58bfc6f9 tempest-GroupSnapshotsTest-1674439300 None] Create group completed successfully. Jul 01 06:45:55 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e" returned: 0 in 0.784s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:55 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec 1G Jul 01 06:45:55 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:56 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec 1G" returned: 0 in 1.347s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:56 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:45:56 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (3e41644e-ba06-4786-93ae-106005a4aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d3e89a-44b6-4070-9262-b9ffc0ce2382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d3e89a-44b6-4070-9262-b9ffc0ce2382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1068610739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf1bd7fd-384e-47c0-9940-c442d9e412ce,host='devstack@QuobyteHD#QuobyteHD',id=f3e0303f-109f-423a-869e-be2217b4fb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:57Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0e9e292-05cc-49ab-9208-0bcc82acd17d),volume_type_id=a0e9e292-05cc-49ab-9208-0bcc82acd17d)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab24ef9-eb5a-4ae9-b4a9-8e47f61787b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab24ef9-eb5a-4ae9-b4a9-8e47f61787b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7050b04-e029-4156-897a-545754a10330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7050b04-e029-4156-897a-545754a10330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e0303f-109f-423a-869e-be2217b4fb20', 'volume_name': 'volume-f3e0303f-109f-423a-869e-be2217b4fb20', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cb19c3-4a6a-4a5e-96f2-9e49cb56c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cb19c3-4a6a-4a5e-96f2-9e49cb56c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2bf296-4c6b-460d-b645-281fd2261625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:45:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Volume f3e0303f-109f-423a-869e-be2217b4fb20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e0303f-109f-423a-869e-be2217b4fb20', 'volume_size': 1} Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:57 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.886s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:57 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec is being set with open permissions: ugo+rw Jul 01 06:45:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:57 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:45:57 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:58 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.667s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:58 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info Jul 01 06:45:58 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:59 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info" returned: 0 in 0.738s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:59 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info is being set with open permissions: ugo+rw Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:59 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info Jul 01 06:45:59 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:59 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.info" returned: 0 in 0.722s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.272s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf1bd7fd-384e-47c0-9940-c442d9e412ce,created_at=2026-07-01T04:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1068610739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf1bd7fd-384e-47c0-9940-c442d9e412ce,host='devstack@QuobyteHD#QuobyteHD',id=f3e0303f-109f-423a-869e-be2217b4fb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:45:57Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0e9e292-05cc-49ab-9208-0bcc82acd17d),volume_type_id=a0e9e292-05cc-49ab-9208-0bcc82acd17d)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Creating volume f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:45:59 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:45:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:45:59 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 1073741824 Jul 01 06:45:59 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:45:59 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a72957e3-8e39-48cb-ab02-70b6c031a4b2 tempest-SnapshotsActionsTest-1753308732 None] Create snapshot completed successfully Jul 01 06:46:00 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 1073741824" returned: 0 in 0.844s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:00 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 Jul 01 06:46:00 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:01 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20" returned: 0 in 0.856s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.054s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2bf296-4c6b-460d-b645-281fd2261625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e0303f-109f-423a-869e-be2217b4fb20', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71760e3e-e4a2-4c7f-b275-b98879b4919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Creating offline snapshot eab27d0c-928f-473f-b0c3-ca6703c3f32f of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:01 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Volume volume-f3e0303f-109f-423a-869e-be2217b4fb20 (f3e0303f-109f-423a-869e-be2217b4fb20): created successfully Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71760e3e-e4a2-4c7f-b275-b98879b4919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (3e41644e-ba06-4786-93ae-106005a4aa53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a32150-02be-4033-bcb3-f8955e84f0d1]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7fa24878-3e64-4c7d-95c0-c9b741ea89b6 tempest-GroupSnapshotsTest-1674439300 None] Created volume successfully. Jul 01 06:46:01 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:01 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (a9b3d539-fe0e-4420-8841-604141876956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a111433d-64d3-4f88-9b7a-cb5260bb24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a111433d-64d3-4f88-9b7a-cb5260bb24b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1109303889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf1bd7fd-384e-47c0-9940-c442d9e412ce,host='devstack@QuobyteHD#QuobyteHD',id=08ab15cf-3f9d-4048-aafc-8582f8a8d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:02Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0e9e292-05cc-49ab-9208-0bcc82acd17d),volume_type_id=a0e9e292-05cc-49ab-9208-0bcc82acd17d)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be03dbf-fbd2-4cf6-8920-2423041868ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be03dbf-fbd2-4cf6-8920-2423041868ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f17191d-c9cd-4c6c-be8a-5b7835e613cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f17191d-c9cd-4c6c-be8a-5b7835e613cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ab15cf-3f9d-4048-aafc-8582f8a8d6a8', 'volume_name': 'volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a114631-2f42-48d5-b0fa-d4170b88ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a114631-2f42-48d5-b0fa-d4170b88ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a9e67b-71a0-4673-93d3-c57977cad99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:02 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Volume 08ab15cf-3f9d-4048-aafc-8582f8a8d6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8', 'volume_size': 1} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:02 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.961s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:02 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f 1G Jul 01 06:46:02 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:03 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f 1G" returned: 0 in 0.812s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:03 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f Jul 01 06:46:03 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:04 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f" returned: 0 in 0.703s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:04 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f is being set with open permissions: ugo+rw Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:04 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f Jul 01 06:46:04 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:04 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f" returned: 0 in 0.669s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.288s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.257s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf1bd7fd-384e-47c0-9940-c442d9e412ce,created_at=2026-07-01T04:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1109303889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf1bd7fd-384e-47c0-9940-c442d9e412ce,host='devstack@QuobyteHD#QuobyteHD',id=08ab15cf-3f9d-4048-aafc-8582f8a8d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:02Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0e9e292-05cc-49ab-9208-0bcc82acd17d),volume_type_id=a0e9e292-05cc-49ab-9208-0bcc82acd17d)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Creating volume 08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:46:04 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:46:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:04 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 1073741824 Jul 01 06:46:04 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:04 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e7ca3852-2306-4ee7-bf26-b8bd829ede57 tempest-SnapshotsActionsTest-1753308732 None] Create snapshot completed successfully Jul 01 06:46:05 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 1073741824" returned: 0 in 0.917s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:05 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 Jul 01 06:46:05 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-eab27d0c-928f-473f-b0c3-ca6703c3f32f-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-eab27d0c-928f-473f-b0c3-ca6703c3f32f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-eab27d0c-928f-473f-b0c3-ca6703c3f32f" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-eab27d0c-928f-473f-b0c3-ca6703c3f32f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Deleting offline snapshot eab27d0c-928f-473f-b0c3-ca6703c3f32f of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] snapshot_file for this snap is: volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a14934-1d00-456a-bd29-9dfa122b0744]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:06 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f Jul 01 06:46:06 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:06 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" returned: 0 in 0.753s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a9e67b-71a0-4673-93d3-c57977cad99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9053b893-7fca-4405-9413-b9b9afe7d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:06 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Volume volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 (08ab15cf-3f9d-4048-aafc-8582f8a8d6a8): created successfully Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9053b893-7fca-4405-9413-b9b9afe7d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (a9b3d539-fe0e-4420-8841-604141876956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a73e0cc0-8171-456e-a7b3-f60c4626ce32 tempest-GroupSnapshotsTest-1674439300 None] Created volume successfully. Jul 01 06:46:06 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f" returned: 0 in 0.824s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[98073431-11d3-41b2-8061-351bbdca94c2]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:06 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:06 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-029ade03-9809-46e0-a24c-4ab85c2b04ad tempest-GroupSnapshotsTest-1674439300 None] Update group completed successfully. Jul 01 06:46:07 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.819s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:07 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f Jul 01 06:46:07 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:08 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f" returned: 0 in 0.747s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:08 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f Jul 01 06:46:08 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c03987d0-94de-41ab-aa79-d61a339a922b tempest-GroupSnapshotsTest-1674439300 None] Update group completed successfully. Jul 01 06:46:09 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.eab27d0c-928f-473f-b0c3-ca6703c3f32f" returned: 0 in 0.680s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-eab27d0c-928f-473f-b0c3-ca6703c3f32f" released by "_delete_snapshot" :: held 3.169s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" released by "delete_snapshot" :: held 3.198s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:09 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Created reservations ['346f711d-ba70-4271-92b1-7ed142039ac8', '21083f97-e090-4f86-82f0-011eb949071e', '78854df2-d182-4e0c-84d2-021ca46ffb19', '15e19392-9c33-4baf-9e87-df1ddc98197e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Delete snapshot completed successfully. Jul 01 06:46:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9f8a14c-132a-484e-92b4-02dd2de3e7b5 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-eab27d0c-928f-473f-b0c3-ca6703c3f32f-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3700bb8e-81a6-464e-938b-c0e7c7245953 tempest-GroupSnapshotsTest-1674439300 None] Update group completed successfully. Jul 01 06:46:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Creating offline snapshot b288eb7a-01a4-45e9-9b41-199d78fb7244 of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eacda77-062e-4235-ab0a-730fba616fb5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:10 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:10 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:11 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-570f1e58-1a75-4db7-b9a8-28b06f59eb3b tempest-GroupSnapshotsTest-1674439300 None] Update group completed successfully. Jul 01 06:46:11 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.783s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:11 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 1G Jul 01 06:46:11 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:12 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 1G" returned: 0 in 0.791s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:12 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 Jul 01 06:46:12 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] GroupSnapshot 2f932802-6995-4898-8fd6-03a7ebc9f29a: creating. Jul 01 06:46:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Group snapshot 2f932802-6995-4898-8fd6-03a7ebc9f29a: creating. {{(pid=86219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 06:46:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:12 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:12 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 is being set with open permissions: ugo+rw Jul 01 06:46:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:12 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 Jul 01 06:46:12 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:13 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244" returned: 0 in 0.626s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.861s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Creating offline snapshot 23a832b6-1a5e-45df-9d7a-02cfc482324b of volume f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e7cb1b47-08d4-4917-af80-a1e0d55008df tempest-SnapshotsActionsTest-1753308732 None] Create snapshot completed successfully Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c80734-5781-4828-a605-b173ef042316]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:13 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 Jul 01 06:46:13 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-b288eb7a-01a4-45e9-9b41-199d78fb7244-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-b288eb7a-01a4-45e9-9b41-199d78fb7244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-b288eb7a-01a4-45e9-9b41-199d78fb7244" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-b288eb7a-01a4-45e9-9b41-199d78fb7244" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Deleting offline snapshot b288eb7a-01a4-45e9-9b41-199d78fb7244 of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] snapshot_file for this snap is: volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09cea15-73ca-4550-a887-d0b7fc94545f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:13 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 Jul 01 06:46:13 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:14 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:14 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b 1G Jul 01 06:46:14 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:14 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244" returned: 0 in 0.774s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce2ea0d-9113-4d34-894a-4515d468147d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:14 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:14 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:15 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b 1G" returned: 0 in 0.806s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e0303f-109f-423a-869e-be2217b4fb20 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:15 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e0303f-109f-423a-869e-be2217b4fb20 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b Jul 01 06:46:15 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:15 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.784s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:15 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 Jul 01 06:46:15 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:15 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e0303f-109f-423a-869e-be2217b4fb20 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b" returned: 0 in 0.710s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:15 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:46:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:15 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b Jul 01 06:46:15 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:16 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244" returned: 0 in 0.813s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:16 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244 Jul 01 06:46:16 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:16 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b" returned: 0 in 0.688s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=99,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=2 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=78,cinder:SELECT=85,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:16 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info Jul 01 06:46:16 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:16 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.b288eb7a-01a4-45e9-9b41-199d78fb7244" returned: 0 in 0.728s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-b288eb7a-01a4-45e9-9b41-199d78fb7244" released by "_delete_snapshot" :: held 3.218s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" released by "delete_snapshot" :: held 3.260s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Created reservations ['71dac550-d5d7-4c86-b54e-8df9d3b28e57', '5e50ef0c-aa0a-4aed-ad3b-c07feb034903', '440f2a2f-715e-45cb-b051-327d4db15702', 'bf6bddb7-9b39-4378-8692-f4a9c2088e3a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Delete snapshot completed successfully. Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-85bca237-f991-40d9-9844-9f39d6d5f63d tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-b288eb7a-01a4-45e9-9b41-199d78fb7244-delete_snapshot" released by "delete_snapshot" :: held 3.415s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:17 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info" returned: 0 in 0.747s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:17 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:17 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info Jul 01 06:46:17 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:17 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.info" returned: 0 in 0.662s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.523s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Creating offline snapshot 9cd438d4-e76f-4516-a57c-2bf8dbac6679 of volume 08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b1aa3-70f9-4f0c-8c0b-80f46e25f187]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:18 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 Jul 01 06:46:18 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:18 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" returned: 0 in 0.773s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:18 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 1G Jul 01 06:46:18 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:19 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 1G" returned: 0 in 0.796s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:19 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 Jul 01 06:46:19 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Flow 'volume_create_manager' (946437ac-5d8e-46da-8f0a-4e95843255ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a685e656-5c42-457a-9e46-a65f91c01670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:20 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679" returned: 0 in 0.770s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:20 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a685e656-5c42-457a-9e46-a65f91c01670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-977722484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3989ca15-8db7-4a6e-89f9-a9cc402829d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ed0b7c781543838d2565689f1d886a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:20Z,use_quota=True,user_id='b53fd5bf5f0d4bcf9d30d771ad807b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed66b63c-21df-49b0-999d-0a2baadca148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:20 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 Jul 01 06:46:20 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed66b63c-21df-49b0-999d-0a2baadca148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da493bee-4087-4081-88df-aa60db7064e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da493bee-4087-4081-88df-aa60db7064e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3989ca15-8db7-4a6e-89f9-a9cc402829d1', 'volume_name': 'volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d3a4e0-5b2f-47fa-8b86-5c5acc28839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d3a4e0-5b2f-47fa-8b86-5c5acc28839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22536a79-1764-4875-913a-9741d6b9316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:20 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Volume 3989ca15-8db7-4a6e-89f9-a9cc402829d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1', 'volume_size': 1} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:20 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679" returned: 0 in 0.618s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:20 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info Jul 01 06:46:20 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:21 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info" returned: 0 in 0.654s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:21 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:46:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:21 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info Jul 01 06:46:21 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:22 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.info" returned: 0 in 0.628s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.332s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.969s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Creating offline snapshot d447a898-3fa9-46be-9aa9-1f00b0492edf of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:22 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d343344a-2ea4-4f01-a2aa-80c415f9dadc]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-82819ef5-f96a-40c6-b4f5-a6ad47e4655b tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 2f932802-6995-4898-8fd6-03a7ebc9f29a: created successfully Jul 01 06:46:22 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:22 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:23 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 2f932802-6995-4898-8fd6-03a7ebc9f29a: deleting Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 2f932802-6995-4898-8fd6-03a7ebc9f29a: deleting {{(pid=86219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 06:46:23 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-f3e0303f-109f-423a-869e-be2217b4fb20" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-f3e0303f-109f-423a-869e-be2217b4fb20" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-23a832b6-1a5e-45df-9d7a-02cfc482324b" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:23 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf 1G Jul 01 06:46:23 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-23a832b6-1a5e-45df-9d7a-02cfc482324b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Deleting offline snapshot 23a832b6-1a5e-45df-9d7a-02cfc482324b of volume f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] snapshot_file for this snap is: volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9c3a92-6bc9-4baa-b676-3c94ca57f3d7]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:23 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b Jul 01 06:46:23 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:23 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf 1G" returned: 0 in 0.852s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:23 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf Jul 01 06:46:23 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:24 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b" returned: 0 in 0.834s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e0303f-109f-423a-869e-be2217b4fb20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb42236-664a-493c-822e-8f70e45464e9]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:24 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 Jul 01 06:46:24 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:24 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf" returned: 0 in 0.686s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:24 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf is being set with open permissions: ugo+rw Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:24 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf Jul 01 06:46:24 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:24 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20" returned: 0 in 0.751s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:24 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b Jul 01 06:46:24 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:25 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf" returned: 0 in 0.628s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.983s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-977722484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3989ca15-8db7-4a6e-89f9-a9cc402829d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ed0b7c781543838d2565689f1d886a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:20Z,use_quota=True,user_id='b53fd5bf5f0d4bcf9d30d771ad807b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Creating volume 3989ca15-8db7-4a6e-89f9-a9cc402829d1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:46:25 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:25 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 1073741824 Jul 01 06:46:25 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:25 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9e541bc8-956e-4266-873e-d2135273a343 tempest-SnapshotsActionsTest-1753308732 None] Create snapshot completed successfully Jul 01 06:46:25 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b" returned: 0 in 0.793s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:25 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b Jul 01 06:46:25 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-d447a898-3fa9-46be-9aa9-1f00b0492edf-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-d447a898-3fa9-46be-9aa9-1f00b0492edf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-d447a898-3fa9-46be-9aa9-1f00b0492edf" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-d447a898-3fa9-46be-9aa9-1f00b0492edf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Deleting offline snapshot d447a898-3fa9-46be-9aa9-1f00b0492edf of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] snapshot_file for this snap is: volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e630e38-7053-4971-a795-c9be5534dbdb]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:25 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf Jul 01 06:46:25 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:26 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 1073741824" returned: 0 in 0.931s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:26 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 Jul 01 06:46:26 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:26 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20.23a832b6-1a5e-45df-9d7a-02cfc482324b" returned: 0 in 0.729s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-23a832b6-1a5e-45df-9d7a-02cfc482324b" released by "_delete_snapshot" :: held 3.213s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-f3e0303f-109f-423a-869e-be2217b4fb20" released by "delete_snapshot" :: held 3.240s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-9cd438d4-e76f-4516-a57c-2bf8dbac6679" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-9cd438d4-e76f-4516-a57c-2bf8dbac6679" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Deleting offline snapshot 9cd438d4-e76f-4516-a57c-2bf8dbac6679 of volume 08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] snapshot_file for this snap is: volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b810cfb-7c50-46c3-9ed9-fd81c1868351]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:26 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:46:26 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:26 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 Jul 01 06:46:26 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:26 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf" returned: 0 in 0.951s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be7229-a15f-4695-a0d5-5d53ab9e4ad8]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:26 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:26 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:26 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1" returned: 0 in 0.709s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22536a79-1764-4875-913a-9741d6b9316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a694736a-9f6f-48d1-9d23-251885a1d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:27 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Volume volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 (3989ca15-8db7-4a6e-89f9-a9cc402829d1): created successfully Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a694736a-9f6f-48d1-9d23-251885a1d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Flow 'volume_create_manager' (946437ac-5d8e-46da-8f0a-4e95843255ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:27 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-bc5e3159-8ce0-4ce8-807a-2e59c2116e8b tempest-AttachVolumeShelveTestJSON-309496590 None] Created volume successfully. Jul 01 06:46:27 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.729s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 8 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:46:27 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679" returned: 0 in 0.835s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff263e9-c93c-4ceb-9ecd-a312115ba614]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:27 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 Jul 01 06:46:27 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:27 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.808s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:27 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf Jul 01 06:46:27 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:28 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" returned: 0 in 0.808s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:28 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 Jul 01 06:46:28 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:28 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf" returned: 0 in 0.861s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:28 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf Jul 01 06:46:28 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:28 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679" returned: 0 in 0.834s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:29 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679 Jul 01 06:46:29 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:29 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.d447a898-3fa9-46be-9aa9-1f00b0492edf" returned: 0 in 0.736s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-d447a898-3fa9-46be-9aa9-1f00b0492edf" released by "_delete_snapshot" :: held 3.470s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" released by "delete_snapshot" :: held 3.496s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Created reservations ['897ead5c-81d3-4e92-b4b9-9cc5095ea724', '09349ee6-ac4e-455b-959c-e0d17f372a8c', 'cb8a4ef5-6a8b-4368-a6b6-603db2f4f224', '99bd43f8-015e-4779-8b30-878088fb02bf'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Delete snapshot completed successfully. Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f00e1180-4379-40d1-a451-354afb9b1b0e tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-d447a898-3fa9-46be-9aa9-1f00b0492edf-delete_snapshot" released by "delete_snapshot" :: held 3.650s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:29 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8.9cd438d4-e76f-4516-a57c-2bf8dbac6679" returned: 0 in 0.677s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-9cd438d4-e76f-4516-a57c-2bf8dbac6679" released by "_delete_snapshot" :: held 3.259s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" released by "delete_snapshot" :: held 3.282s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:29 devstack cinder-volume[86219]: WARNING cinder.quota [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-31040344 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-31040344, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:46:29 devstack cinder-volume[86219]: WARNING cinder.quota [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-31040344 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-31040344, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['b2deb6e5-eaec-461a-9526-e6905847c154', '8b1408cd-f56a-4731-bbc7-fa50f2b0f370', 'e043a5cb-b125-4df9-953e-fca9812e9fee', '630dc8d1-eed1-4f6e-bffe-92ebef6b0216'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['12ac9580-7543-4c80-b9b5-429c25f419a9', '125393c2-1eca-42a1-868d-b494a125193c', 'f069ea16-4c9c-445b-97f6-388e16e1a28f', 'c74be582-9e20-4ccf-a6d7-7be02d9a0d0e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d603cd41-0503-47f0-88e6-989a1383fdf9 tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 2f932802-6995-4898-8fd6-03a7ebc9f29a: deleted successfully Jul 01 06:46:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Creating offline snapshot 5364d077-b405-44c3-87d2-aa2fa3524fb9 of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795215d-9d89-494d-8146-18a5ea9c7d14]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:30 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:30 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:31 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 1.064s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:31 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 1G Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:31 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3f17e-8d54-4ebf-b469-a0a0778fb036]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:31 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 Jul 01 06:46:31 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:32 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 1G" returned: 0 in 0.900s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:32 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:32 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 Jul 01 06:46:32 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" returned: 0 in 0.818s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:32 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8 Jul 01 06:46:32 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:32 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" returned: 0 in 0.647s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-08ab15cf-3f9d-4048-aafc-8582f8a8d6a8" released by "delete_volume" :: held 1.567s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-f3e0303f-109f-423a-869e-be2217b4fb20" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:33 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-f3e0303f-109f-423a-869e-be2217b4fb20" acquired by "delete_volume" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9" returned: 0 in 0.765s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:33 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 is being set with open permissions: ugo+rw Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8a5a34-7bab-41ee-9b67-d0830226c47a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:33 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 Jul 01 06:46:33 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:33 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 Jul 01 06:46:33 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:33 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9" returned: 0 in 0.762s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.608s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7909442d-0f5f-4745-85b3-56b8d15739d3 tempest-SnapshotsActionsTest-1753308732 None] Create snapshot completed successfully Jul 01 06:46:33 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20" returned: 0 in 0.883s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:33 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20 Jul 01 06:46:33 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-5364d077-b405-44c3-87d2-aa2fa3524fb9-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-5364d077-b405-44c3-87d2-aa2fa3524fb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:34 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Acquiring lock "cinder-quobyte-5364d077-b405-44c3-87d2-aa2fa3524fb9" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3e0303f-109f-423a-869e-be2217b4fb20" returned: 0 in 0.717s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-f3e0303f-109f-423a-869e-be2217b4fb20" released by "delete_volume" :: held 1.679s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-5364d077-b405-44c3-87d2-aa2fa3524fb9" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Deleting offline snapshot 5364d077-b405-44c3-87d2-aa2fa3524fb9 of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] snapshot_file for this snap is: volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710e362-bcd0-41ef-9cd4-e18f9e7d75d8]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['92bc6d59-cf0a-4f85-a788-44a71c64b6df'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:34 devstack cinder-volume[86219]: WARNING cinder.quota [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-31040344 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-31040344, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:46:34 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['8ad38fff-460e-443c-ba26-2cede526bb92', 'a24f6f84-08b8-424f-b8b6-36a5fe800c9a', 'b9b2dcdd-d38d-43cd-9b03-ae9a0ccbac93', 'c8e87285-cbd1-4e17-a1e7-c5079355b815'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:34 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 Jul 01 06:46:34 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['22af0167-14e7-4cfd-a475-70a01a954a2e', '17e00787-d89e-4147-af43-8deedfdffeb9', '8f209649-0349-49c6-92a9-f7a726e40650', 'aec7187b-ddd8-4ec0-93a8-4965ea97dce2'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:35 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:46:35 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:35 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9" returned: 0 in 0.862s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[30794663-d25b-4fed-b62c-0be58948a4e9]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:35 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:35 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:35 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.720s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:35 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:46:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d7d01a78-cd86-4b3a-bbd3-c1bdcafb1c00 tempest-GroupSnapshotsTest-1674439300 None] Delete group completed successfully. Jul 01 06:46:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-436d7086-0708-45d7-965c-ee3684dc0c7a tempest-GroupSnapshotsTest-1674439300 None] Group tempest-GroupSnapshotsTest-Group-1256191607: creating Jul 01 06:46:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-436d7086-0708-45d7-965c-ee3684dc0c7a tempest-GroupSnapshotsTest-1674439300 None] Group tempest-GroupSnapshotsTest-Group-1256191607: created successfully Jul 01 06:46:36 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-436d7086-0708-45d7-965c-ee3684dc0c7a tempest-GroupSnapshotsTest-1674439300 None] Create group completed successfully. Jul 01 06:46:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 1.134s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:36 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 Jul 01 06:46:36 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:37 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9" returned: 0 in 0.852s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:37 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9 Jul 01 06:46:37 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:38 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.5364d077-b405-44c3-87d2-aa2fa3524fb9" returned: 0 in 0.659s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-5364d077-b405-44c3-87d2-aa2fa3524fb9" released by "_delete_snapshot" :: held 3.637s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" released by "delete_snapshot" :: held 3.688s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (dbe2292b-1041-4459-96ea-0a8152c139d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e497ae8c-da4f-46b9-8e19-ebda4f6b69d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e497ae8c-da4f-46b9-8e19-ebda4f6b69d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1651920395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c916e425-a0c9-461d-b8e3-88ce773394e2,host='devstack@QuobyteHD#QuobyteHD',id=80e39fd6-8999-413a-b9de-5c55f7cab926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:38Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85243ed3-5df3-4f33-a2d2-a1097f38646b),volume_type_id=85243ed3-5df3-4f33-a2d2-a1097f38646b)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f53887-f7ec-47f2-852a-fa6e0b7c5687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f53887-f7ec-47f2-852a-fa6e0b7c5687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88267e9-9f41-4331-a957-eaaa19b9ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88267e9-9f41-4331-a957-eaaa19b9ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e39fd6-8999-413a-b9de-5c55f7cab926', 'volume_name': 'volume-80e39fd6-8999-413a-b9de-5c55f7cab926', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79623390-7b07-40d6-bfdf-4f462b3951fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79623390-7b07-40d6-bfdf-4f462b3951fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cebc34-0c73-4c73-a53b-a5fab9331c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:38 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Volume 80e39fd6-8999-413a-b9de-5c55f7cab926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e39fd6-8999-413a-b9de-5c55f7cab926', 'volume_size': 1} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c916e425-a0c9-461d-b8e3-88ce773394e2,created_at=2026-07-01T04:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1651920395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c916e425-a0c9-461d-b8e3-88ce773394e2,host='devstack@QuobyteHD#QuobyteHD',id=80e39fd6-8999-413a-b9de-5c55f7cab926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7d2d396c694a3592970b3f24517cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:38Z,use_quota=True,user_id='9e9f68f470194441ae95bfff17e5c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85243ed3-5df3-4f33-a2d2-a1097f38646b),volume_type_id=85243ed3-5df3-4f33-a2d2-a1097f38646b)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Creating volume 80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:46:38 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:38 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 1073741824 Jul 01 06:46:38 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Created reservations ['53bbb721-a1e3-434e-9745-9847cf48247a', '8995453d-39ef-450f-a3d6-1bbe371ec207', '9a179233-a38c-436b-8c5e-e65e892cf7ad', '66cd5ab9-6460-47bb-aedf-c2c94097209b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:38 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Delete snapshot completed successfully. Jul 01 06:46:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-62267b64-750f-4471-9796-9cee813d1d48 tempest-SnapshotsActionsTest-814035892 None] Lock "cinder-5364d077-b405-44c3-87d2-aa2fa3524fb9-delete_snapshot" released by "delete_snapshot" :: held 3.978s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "cinder-ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "cinder-quobyte-ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-quobyte-ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Deleting offline snapshot ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec of volume f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] snapshot_file for this snap is: volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad88ed-a948-4b79-9d38-000ca5e3a501]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:39 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 1073741824" returned: 0 in 0.980s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:39 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:39 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:39 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 Jul 01 06:46:39 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:40 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:40 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.815s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f816302d-9dc1-455a-b2b9-7530b765452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926" returned: 0 in 0.729s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1617f620-3669-4b2e-93e3-52b931b1298d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cebc34-0c73-4c73-a53b-a5fab9331c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e39fd6-8999-413a-b9de-5c55f7cab926', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a6e68f-9c0d-42bb-ac38-b0e550a93e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Volume volume-80e39fd6-8999-413a-b9de-5c55f7cab926 (80e39fd6-8999-413a-b9de-5c55f7cab926): created successfully Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a6e68f-9c0d-42bb-ac38-b0e550a93e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Flow 'volume_create_manager' (dbe2292b-1041-4459-96ea-0a8152c139d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a953049f-5ed5-4d30-ac70-3d24cbb05696 tempest-GroupSnapshotsTest-1674439300 None] Created volume successfully. Jul 01 06:46:40 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e Jul 01 06:46:40 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] GroupSnapshot 9c0e8a52-b702-49cb-95c9-3929d509baf2: creating. Jul 01 06:46:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Group snapshot 9c0e8a52-b702-49cb-95c9-3929d509baf2: creating. {{(pid=86219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Creating offline snapshot af1ed46b-031f-471f-bd31-47177ad85e0c of volume 80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[161227c3-239b-44ec-82df-1aad44f98398]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:41 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e" returned: 0 in 0.826s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:41 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:41 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:41 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 Jul 01 06:46:41 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:41 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926" returned: 0 in 0.861s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:41 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c 1G Jul 01 06:46:41 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:42 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.940s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:42 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec Jul 01 06:46:42 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:42 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e.ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-quobyte-ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec" released by "_delete_snapshot" :: held 3.376s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" released by "delete_snapshot" :: held 3.403s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:42 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c 1G" returned: 0 in 0.880s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e39fd6-8999-413a-b9de-5c55f7cab926 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:42 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e39fd6-8999-413a-b9de-5c55f7cab926 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c Jul 01 06:46:42 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Created reservations ['624da7dc-d13b-4241-8522-a99b8ccad851', 'eb1ad5f0-7a73-428a-b9eb-74a3c6f7d05c', '9255bdda-551c-441b-86af-b86fcb948abf', 'e4b05417-7144-4688-b829-cedb70a5d41f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:42 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Delete snapshot completed successfully. Jul 01 06:46:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-eaebb905-3ca0-45f0-b87d-06b32194d567 tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-ee4341d5-e7b3-49bd-ba09-60a44ab5d9ec-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-1fc1a23b-3cf8-4e59-b77e-e0cfe574cfdc req-1795281c-6adc-470c-a184-312556a3a23a tempest-AttachVolumeShelveTestJSON-309496590 None] No connector for attachment 0bcbe553-53bc-4942-a531-27a837327285; skipping storage backend terminate_connection call. {{(pid=86219) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-1fc1a23b-3cf8-4e59-b77e-e0cfe574cfdc req-1795281c-6adc-470c-a184-312556a3a23a tempest-AttachVolumeShelveTestJSON-309496590 None] Deleting attachment 0bcbe553-53bc-4942-a531-27a837327285. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:46:43 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e39fd6-8999-413a-b9de-5c55f7cab926 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c" returned: 0 in 0.744s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:43 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:43 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c Jul 01 06:46:43 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "cinder-f816302d-9dc1-455a-b2b9-7530b765452e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-f816302d-9dc1-455a-b2b9-7530b765452e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a74175-f768-4092-96e2-3a1dabd6c577]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:43 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e Jul 01 06:46:43 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:44 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c" returned: 0 in 0.697s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:44 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info Jul 01 06:46:44 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:44 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e" returned: 0 in 0.826s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:44 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e Jul 01 06:46:44 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:45 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info" returned: 0 in 0.778s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:45 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:45 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info Jul 01 06:46:45 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:45 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f816302d-9dc1-455a-b2b9-7530b765452e" returned: 0 in 0.694s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-quobyte-f816302d-9dc1-455a-b2b9-7530b765452e" released by "delete_volume" :: held 1.592s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Created reservations ['54192829-e8ea-447b-acf5-67355cabe082', '09a1ddbb-fc86-47a9-a4d6-bd4fe9dc800f', '83565cdb-b26f-4a45-ad03-af4f66eaa9a1', '32008cf0-4fc1-4998-9b8f-15d563eca155'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:45 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:46:45 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:45 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.info" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.774s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-199cac07-0795-4221-9315-ae7dcec13488 tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9c0e8a52-b702-49cb-95c9-3929d509baf2: created successfully Jul 01 06:46:46 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.765s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:46:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Deleted volume successfully. Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92d138fe-05fe-4552-b90e-04a32ed8d87c tempest-SnapshotsActionsTest-1753308732 None] Lock "cinder-f816302d-9dc1-455a-b2b9-7530b765452e-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9c0e8a52-b702-49cb-95c9-3929d509baf2: deleting Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9c0e8a52-b702-49cb-95c9-3929d509baf2: deleting {{(pid=86219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-80e39fd6-8999-413a-b9de-5c55f7cab926" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-80e39fd6-8999-413a-b9de-5c55f7cab926" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-af1ed46b-031f-471f-bd31-47177ad85e0c" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-af1ed46b-031f-471f-bd31-47177ad85e0c" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Deleting offline snapshot af1ed46b-031f-471f-bd31-47177ad85e0c of volume 80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] snapshot_file for this snap is: volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec961f68-5809-4b85-bde9-d98f2fd10452]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:46 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c Jul 01 06:46:46 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:47 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e39fd6-8999-413a-b9de-5c55f7cab926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:46:47 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9add3-2bd9-4ad1-9b37-408cdee49cd4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:47 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 Jul 01 06:46:47 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:48 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926" returned: 0 in 0.808s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:48 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c Jul 01 06:46:48 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:49 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c" returned: 0 in 0.809s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:49 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c Jul 01 06:46:49 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:49 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926.af1ed46b-031f-471f-bd31-47177ad85e0c" returned: 0 in 0.655s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-af1ed46b-031f-471f-bd31-47177ad85e0c" released by "_delete_snapshot" :: held 3.263s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-80e39fd6-8999-413a-b9de-5c55f7cab926" released by "delete_snapshot" :: held 3.306s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:49 devstack cinder-volume[86219]: WARNING cinder.quota [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-843362556 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-843362556, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:46:49 devstack cinder-volume[86219]: WARNING cinder.quota [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-843362556 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-843362556, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:46:49 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['9af24734-cedf-4b3d-b6f9-1c9dd210ffd0', '113caa26-6810-4704-83a2-2459afde389a', '0be958e3-6b75-47ca-969d-c56df3b33d06', '2f2d1d32-8d8a-47fe-9aee-da982a710094'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0d8fed17-5d46-419c-89cf-c4a126f18b1c tempest-GroupSnapshotsTest-1674439300 None] group_snapshot 9c0e8a52-b702-49cb-95c9-3929d509baf2: deleted successfully Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "cinder-quobyte-80e39fd6-8999-413a-b9de-5c55f7cab926" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-80e39fd6-8999-413a-b9de-5c55f7cab926" acquired by "delete_volume" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3372bc-b35d-459d-8b44-f31caced69bc]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Flow 'volume_create_manager' (673539b9-0065-4420-a0ef-c87a05b9e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fd1e07-c9a8-4a0e-9dc1-9eb7555f565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fd1e07-c9a8-4a0e-9dc1-9eb7555f565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1661930733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ce568c-a82d-49ed-a835-c310a5f4e7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde777c45a844d4fa18fa8edb746ae1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:51Z,use_quota=True,user_id='605f4988af104d9895b1d9f0c9c26777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:51 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 Jul 01 06:46:51 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cdf474a-1f92-4e2c-9cab-dbd8cdc87460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cdf474a-1f92-4e2c-9cab-dbd8cdc87460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd12534b-c261-457b-9263-8ac8e25a1672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd12534b-c261-457b-9263-8ac8e25a1672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ce568c-a82d-49ed-a835-c310a5f4e7f1', 'volume_name': 'volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75f15fd-9e74-42d7-822e-4a161b49c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75f15fd-9e74-42d7-822e-4a161b49c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d39fa8-7c16-46b8-8186-aa6a5963e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Volume 95ce568c-a82d-49ed-a835-c310a5f4e7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1', 'volume_size': 1} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1661930733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ce568c-a82d-49ed-a835-c310a5f4e7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde777c45a844d4fa18fa8edb746ae1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:46:51Z,use_quota=True,user_id='605f4988af104d9895b1d9f0c9c26777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Creating volume 95ce568c-a82d-49ed-a835-c310a5f4e7f1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:46:51 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:46:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:51 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 1073741824 Jul 01 06:46:51 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:52 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926" returned: 0 in 0.871s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:52 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926 Jul 01 06:46:52 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:52 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 1073741824" returned: 0 in 0.966s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:52 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 Jul 01 06:46:52 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:52 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-80e39fd6-8999-413a-b9de-5c55f7cab926" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Lock "cinder-quobyte-80e39fd6-8999-413a-b9de-5c55f7cab926" released by "delete_volume" :: held 1.696s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['069af4dc-b422-4274-8139-2b24d6bf3a9e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:53 devstack cinder-volume[86219]: WARNING cinder.quota [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-843362556 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-843362556, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Created reservations ['95e963ea-d8d0-4fbd-aafb-31648f4053e7', '09d83c1b-9a4c-4d91-89bb-f88d9b082fde', '2875aace-6539-4518-a620-c6f9fe6259bb', '560a9758-7ff7-4d70-84b1-dd65ac9de4c3'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:53 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:46:53 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:53 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d39fa8-7c16-46b8-8186-aa6a5963e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94c2c95-0af0-455e-afa6-a2cd1da6e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:46:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Volume volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 (95ce568c-a82d-49ed-a835-c310a5f4e7f1): created successfully Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94c2c95-0af0-455e-afa6-a2cd1da6e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Flow 'volume_create_manager' (673539b9-0065-4420-a0ef-c87a05b9e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:46:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-94bfc071-94ef-4a8c-88c8-afc5cafe5cba tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Created volume successfully. Jul 01 06:46:53 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.719s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:53 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:46:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b9b956ff-bd32-414b-b8b8-31f81ddeadb9 tempest-GroupSnapshotsTest-1674439300 None] Delete group completed successfully. Jul 01 06:46:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Acquiring lock "cinder-95ce568c-a82d-49ed-a835-c310a5f4e7f1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "cinder-95ce568c-a82d-49ed-a835-c310a5f4e7f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Acquiring lock "cinder-quobyte-95ce568c-a82d-49ed-a835-c310a5f4e7f1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:46:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "cinder-quobyte-95ce568c-a82d-49ed-a835-c310a5f4e7f1" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:46:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fe08a9-28b0-4f66-8c4f-2e8775846480]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:46:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:54 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 Jul 01 06:46:54 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:55 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1" returned: 0 in 1.058s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:55 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1 Jul 01 06:46:55 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:56 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95ce568c-a82d-49ed-a835-c310a5f4e7f1" returned: 0 in 0.763s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "cinder-quobyte-95ce568c-a82d-49ed-a835-c310a5f4e7f1" released by "delete_volume" :: held 1.876s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Created reservations ['6df879f9-0aa8-4f8b-afb8-18dc5f88955f', '619e946b-9b77-4054-945d-fc3b8bfb8527', 'a33c3fd5-f2e9-45e6-a0bc-3c0efe574fba', 'aeea4ed8-a810-4f47-af5a-78ba8971b200'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:46:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:46:56 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:46:56 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:46:57 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 01 06:46:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.783s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:46:57 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:46:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Deleted volume successfully. Jul 01 06:46:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-250602b5-dec6-4d31-b55e-918d615b915d tempest-VolumeQuotasNegativeTestJSON-1728678717 None] Lock "cinder-95ce568c-a82d-49ed-a835-c310a5f4e7f1-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Flow 'volume_create_manager' (c7f9a8e1-f96b-4b95-9c01-75117262b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2c9972-982b-491b-8bd3-5b14377cc8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2c9972-982b-491b-8bd3-5b14377cc8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2016322211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96ce609-e416-47c8-a33c-6004be128656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9943115aa94229ba0b33c50fbcb1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:47:04Z,use_quota=True,user_id='cd0466bd2719495d9330f6049e991259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6317d197-0862-435f-8caf-04faf3a5287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6317d197-0862-435f-8caf-04faf3a5287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa9363b-a65d-42d5-b086-2ce50c52b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa9363b-a65d-42d5-b086-2ce50c52b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96ce609-e416-47c8-a33c-6004be128656', 'volume_name': 'volume-f96ce609-e416-47c8-a33c-6004be128656', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376333e3-562b-4e51-b6a5-835c3d590a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376333e3-562b-4e51-b6a5-835c3d590a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8413d4c-5380-4880-9005-cc3b81c04e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:04 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Volume f96ce609-e416-47c8-a33c-6004be128656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96ce609-e416-47c8-a33c-6004be128656', 'volume_size': 1} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2016322211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96ce609-e416-47c8-a33c-6004be128656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9943115aa94229ba0b33c50fbcb1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:47:04Z,use_quota=True,user_id='cd0466bd2719495d9330f6049e991259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Creating volume f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:47:04 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:47:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:04 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 1073741824 Jul 01 06:47:04 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:05 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 1073741824" returned: 0 in 1.205s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:05 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 Jul 01 06:47:05 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:06 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8413d4c-5380-4880-9005-cc3b81c04e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96ce609-e416-47c8-a33c-6004be128656', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e266d6-bb19-43cf-9ed5-50c1690f7ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:06 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Volume volume-f96ce609-e416-47c8-a33c-6004be128656 (f96ce609-e416-47c8-a33c-6004be128656): created successfully Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e266d6-bb19-43cf-9ed5-50c1690f7ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Flow 'volume_create_manager' (c7f9a8e1-f96b-4b95-9c01-75117262b482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:47:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0b75d420-0a3b-41d1-abab-ca8d1bca8d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Created volume successfully. Jul 01 06:47:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-00030ea3-eff1-4356-b7ab-4e1d82bbd301 tempest-GroupsV314Test-1779413187 None] Group tempest-GroupsV314Test-Group-2123000030: creating Jul 01 06:47:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-00030ea3-eff1-4356-b7ab-4e1d82bbd301 tempest-GroupsV314Test-1779413187 None] Group tempest-GroupsV314Test-Group-2123000030: created successfully Jul 01 06:47:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-00030ea3-eff1-4356-b7ab-4e1d82bbd301 tempest-GroupsV314Test-1779413187 None] Create group completed successfully. Jul 01 06:47:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Creating offline snapshot 488bfb7f-b762-40c2-9f85-b237050f0687 of volume f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:47:07 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5578fa5-21ce-49ec-b22c-c141836f0c2c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:07 devstack sudo[91829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 Jul 01 06:47:07 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:08 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656" returned: 0 in 0.752s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:08 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 1G Jul 01 06:47:08 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Flow 'volume_create_manager' (b95d059e-ebed-46b9-9fe5-2877af58ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc2848b-1cf9-4db3-974b-83acbb885299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc2848b-1cf9-4db3-974b-83acbb885299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-399865292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7f32db7-1bdf-4cdf-aaa5-e99b73d1dfda,host='devstack@QuobyteHD#QuobyteHD',id=0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bae9ce77ad84bbb99d3258eb740ab9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:47:09Z,use_quota=True,user_id='4cf420f1d4204093a941810dc4f1f6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fea002a-e3a1-4c63-886c-08d4741114b7),volume_type_id=7fea002a-e3a1-4c63-886c-08d4741114b7)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d381884c-938e-4575-86a7-00942f4b0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d381884c-938e-4575-86a7-00942f4b0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acb7fd9-30f8-488d-8c88-c5f53a04034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acb7fd9-30f8-488d-8c88-c5f53a04034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce', 'volume_name': 'volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c430757-d57b-48a0-8ff5-4fadc50d43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c430757-d57b-48a0-8ff5-4fadc50d43f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63777a96-e031-46c5-bf88-7b0653ebfa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Volume 0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce', 'volume_size': 1} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:09 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 1G" returned: 0 in 0.874s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ce609-e416-47c8-a33c-6004be128656 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:09 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ce609-e416-47c8-a33c-6004be128656 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 Jul 01 06:47:09 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:09 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ce609-e416-47c8-a33c-6004be128656 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687" returned: 0 in 0.707s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:09 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 is being set with open permissions: ugo+rw Jul 01 06:47:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:09 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 Jul 01 06:47:09 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:10 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:10 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info Jul 01 06:47:10 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:11 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info" returned: 0 in 0.704s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:11 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info is being set with open permissions: ugo+rw Jul 01 06:47:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:11 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info Jul 01 06:47:11 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:11 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.info" returned: 0 in 0.709s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.510s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7f32db7-1bdf-4cdf-aaa5-e99b73d1dfda,created_at=2026-07-01T04:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-399865292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7f32db7-1bdf-4cdf-aaa5-e99b73d1dfda,host='devstack@QuobyteHD#QuobyteHD',id=0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bae9ce77ad84bbb99d3258eb740ab9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:47:09Z,use_quota=True,user_id='4cf420f1d4204093a941810dc4f1f6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fea002a-e3a1-4c63-886c-08d4741114b7),volume_type_id=7fea002a-e3a1-4c63-886c-08d4741114b7)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Creating volume 0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:47:12 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:12 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce 1073741824 Jul 01 06:47:12 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2458554e-53f2-4521-83d0-65b3968d3bbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Create snapshot completed successfully Jul 01 06:47:12 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce 1073741824" returned: 0 in 0.866s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:12 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:12 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "cinder-488bfb7f-b762-40c2-9f85-b237050f0687-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-488bfb7f-b762-40c2-9f85-b237050f0687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "cinder-quobyte-f96ce609-e416-47c8-a33c-6004be128656" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-quobyte-f96ce609-e416-47c8-a33c-6004be128656" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "cinder-quobyte-488bfb7f-b762-40c2-9f85-b237050f0687" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-quobyte-488bfb7f-b762-40c2-9f85-b237050f0687" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Deleting offline snapshot 488bfb7f-b762-40c2-9f85-b237050f0687 of volume f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] snapshot_file for this snap is: volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b1321-0ec3-44df-b2ac-d9e7ba749b96]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:13 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 Jul 01 06:47:13 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:13 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 0.786s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63777a96-e031-46c5-bf88-7b0653ebfa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bf84c5-f60e-4e4c-afe6-ae8d92273cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:47:13 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Volume volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce (0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce): created successfully Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bf84c5-f60e-4e4c-afe6-ae8d92273cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:47:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Flow 'volume_create_manager' (b95d059e-ebed-46b9-9fe5-2877af58ba30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:47:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-02a77596-1703-4da9-94c4-dcf0ec7880bb tempest-GroupsV314Test-1779413187 None] Created volume successfully. Jul 01 06:47:14 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ce609-e416-47c8-a33c-6004be128656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:47:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2933783-8a1d-4982-9f90-0d49b17eb075]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:14 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 Jul 01 06:47:14 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:15 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656" returned: 0 in 0.779s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:15 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 Jul 01 06:47:15 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:15 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687" returned: 0 in 0.766s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:15 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687 Jul 01 06:47:15 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:16 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Cloning volume 0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce to volume edb6bb58-cef6-49c8-93cb-0e4ab1962342 Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Creating offline snapshot 2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 of volume 0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b5536-c447-439e-8fa5-4971ac416995]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:16 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:16 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:16 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656.488bfb7f-b762-40c2-9f85-b237050f0687" returned: 0 in 0.763s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=117,cinder:INSERT=28,cinder:UPDATE=101,cinder:DELETE=2 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=99,cinder:INSERT=32,cinder:UPDATE=123,cinder:DELETE=8 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-quobyte-488bfb7f-b762-40c2-9f85-b237050f0687" released by "_delete_snapshot" :: held 3.301s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-quobyte-f96ce609-e416-47c8-a33c-6004be128656" released by "delete_snapshot" :: held 3.339s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Created reservations ['f5501b0e-7b37-47a4-ac1c-cb802ef7e743', '14ddd6ba-4f59-46fe-b003-1e9e3d2af32d', 'a6fda834-dbc2-48e4-8553-676f7c67f1cc', '87b6b45e-5cd3-48fb-8c68-ceebe7d92943'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Delete snapshot completed successfully. Jul 01 06:47:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8f709a27-ea9e-43a8-9e60-cab0b638fbe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-488bfb7f-b762-40c2-9f85-b237050f0687-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:17 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 0.894s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:17 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 1G Jul 01 06:47:17 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "cinder-f96ce609-e416-47c8-a33c-6004be128656-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-f96ce609-e416-47c8-a33c-6004be128656-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "cinder-quobyte-f96ce609-e416-47c8-a33c-6004be128656" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-quobyte-f96ce609-e416-47c8-a33c-6004be128656" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eea006-2eb2-4a0b-a4c0-ee18dbd1980a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:17 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 Jul 01 06:47:17 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:17 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 1G" returned: 0 in 0.863s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:17 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 Jul 01 06:47:17 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:18 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656" returned: 0 in 0.750s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:18 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656 Jul 01 06:47:18 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:18 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" returned: 0 in 0.677s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:18 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:47:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:18 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 Jul 01 06:47:18 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:19 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f96ce609-e416-47c8-a33c-6004be128656" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-quobyte-f96ce609-e416-47c8-a33c-6004be128656" released by "delete_volume" :: held 1.486s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Created reservations ['1e178b7b-0ff8-4c8d-a50f-07f051504962', '2fc5a3cd-d72a-47c9-b328-897af9433142', 'ae194eef-1910-4733-96e0-1a4b4411fad3', 'cedf0377-0d37-42b3-bb75-7682e8c2bba5'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:19 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:47:19 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:19 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" returned: 0 in 0.674s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:19 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info Jul 01 06:47:19 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:19 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.689s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:47:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Deleted volume successfully. Jul 01 06:47:19 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f31ff74-40b5-48f7-910c-2a48094c939e tempest-VolumeSnapshotQuotasNegativeTestJSON-1992917972 None] Lock "cinder-f96ce609-e416-47c8-a33c-6004be128656-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info" returned: 0 in 0.652s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:19 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:47:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:20 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info Jul 01 06:47:20 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:20 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.info" returned: 0 in 0.667s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Acquiring lock "cinder-quobyte-edb6bb58-cef6-49c8-93cb-0e4ab1962342" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-edb6bb58-cef6-49c8-93cb-0e4ab1962342" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] snapshot: 2d0fa36b-4e3f-4b3b-b410-f50486c82bf3, volume: edb6bb58-cef6-49c8-93cb-0e4ab1962342, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f923b99-a285-4832-b9d3-0de363101a89]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:20 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 Jul 01 06:47:20 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:21 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" returned: 0 in 0.784s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:47:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:47:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:47:21 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12660c-8e52-4c92-9e5f-d6d470f5cc16]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:21 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:21 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:22 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 0.922s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:22 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:47:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:22 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 Jul 01 06:47:22 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:26 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:47:26 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:28 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342" returned: 0 in 5.627s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c4feb-402b-43e6-b716-69c653ad2b06]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:28 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.785s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 8 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:47:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:47:28 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:28 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:29 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=14 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:47:29 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 1.242s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:29 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:47:29 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Converted 1024.00 MB image at 181.93 MB/s Jul 01 06:47:29 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 06:47:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:29 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 Jul 01 06:47:29 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:29 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:47:30 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342" returned: 0 in 0.747s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-edb6bb58-cef6-49c8-93cb-0e4ab1962342" released by "_copy_volume_from_snapshot" :: held 9.429s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Acquiring lock "cinder-quobyte-2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Deleting offline snapshot 2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 of volume 0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] snapshot_file for this snap is: volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ba137-1bfe-4dda-b062-3854f2302772]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:30 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 Jul 01 06:47:30 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:31 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" returned: 0 in 1.113s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:47:31 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaca750-1678-41fc-b5e3-388f56cf206b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:31 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:31 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:32 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 0.816s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:32 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 Jul 01 06:47:32 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:33 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" returned: 0 in 0.892s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:33 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3 Jul 01 06:47:33 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:33 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce.2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-2d0fa36b-4e3f-4b3b-b410-f50486c82bf3" released by "_delete_snapshot" :: held 3.705s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.792s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-46fb0b48-4842-491a-9cae-23a8fc4f0962 tempest-GroupsV314Test-1779413187 None] Create group from source-group-a7f32db7-1bdf-4cdf-aaa5-e99b73d1dfda completed successfully. Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Acquiring lock "cinder-quobyte-edb6bb58-cef6-49c8-93cb-0e4ab1962342" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-edb6bb58-cef6-49c8-93cb-0e4ab1962342" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f26dad5-4a50-4ebd-9752-2f88cecd9a4e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:35 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 Jul 01 06:47:35 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Acquiring lock "cinder-3989ca15-8db7-4a6e-89f9-a9cc402829d1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "cinder-3989ca15-8db7-4a6e-89f9-a9cc402829d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Acquiring lock "cinder-quobyte-3989ca15-8db7-4a6e-89f9-a9cc402829d1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "cinder-quobyte-3989ca15-8db7-4a6e-89f9-a9cc402829d1" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3856c0-4b7d-423a-8f04-3abbdf460b3f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:35 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 Jul 01 06:47:35 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:36 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342" returned: 0 in 0.861s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:36 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342 Jul 01 06:47:36 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:36 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1" returned: 0 in 0.849s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:36 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1 Jul 01 06:47:36 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:37 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-edb6bb58-cef6-49c8-93cb-0e4ab1962342" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-edb6bb58-cef6-49c8-93cb-0e4ab1962342" released by "delete_volume" :: held 1.810s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Created reservations ['1875ce8c-0efc-43aa-a57b-dc186d9a1cbc'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:37 devstack cinder-volume[86219]: WARNING cinder.quota [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1979436881 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1979436881, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:47:37 devstack cinder-volume[86219]: WARNING cinder.quota [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1979436881 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1979436881, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Created reservations ['893057c6-5c73-4ad3-af03-faeebd89703a', 'eda62d46-0e51-4391-a005-789fbefea074', '35d313a4-c1bb-411e-b534-c215a1717a47', '9fa26354-521f-4ba4-91dc-7325f781e2e1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:37 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3989ca15-8db7-4a6e-89f9-a9cc402829d1" returned: 0 in 0.859s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "cinder-quobyte-3989ca15-8db7-4a6e-89f9-a9cc402829d1" released by "delete_volume" :: held 1.755s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Created reservations ['056d279f-8100-4bc7-b531-5bbbfb385280', 'fa69d755-5019-48c3-980f-aab4576d7aee', 'bd98f1ce-7914-497d-ba62-184b00191262', 'd1fbdfe9-ab1e-4971-9a75-fba4e7d218c4'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:37 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:47:37 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:37 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:47:37 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:38 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.922s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:47:38 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ec16890b-c684-4760-806b-26c976507be9 tempest-GroupsV314Test-1779413187 None] Delete group completed successfully. Jul 01 06:47:38 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Acquiring lock "cinder-quobyte-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.891s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:47:38 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Deleted volume successfully. Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd234cf-5e98-46ac-af01-bdd8debec672]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8590be83-c99c-4884-aa12-8cb3eef16418 tempest-AttachVolumeShelveTestJSON-309496590 None] Lock "cinder-3989ca15-8db7-4a6e-89f9-a9cc402829d1-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:38 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:38 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:39 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 0.844s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:39 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce Jul 01 06:47:39 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:40 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" returned: 0 in 0.733s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Lock "cinder-quobyte-0d54f603-8dd9-4376-8ff5-0b0a1cc6e7ce" released by "delete_volume" :: held 1.681s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Created reservations ['bc323f9e-4528-4776-bbbe-6262e17a04ab'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Created reservations ['6c1913a2-b222-419a-a9f4-20bcc16dc67e', '0b597d16-00c0-4619-98f4-f728e5013e23', 'e364f792-fd45-4c71-82dd-18f12c30e36e', '3aad7c00-1542-4220-9870-532336c34961'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:40 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:47:40 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:41 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.832s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:41 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:47:41 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-28f3a9d1-3636-4e42-9021-fc156c65c17e tempest-GroupsV314Test-1779413187 None] Delete group completed successfully. Jul 01 06:47:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-65b3b746-acc8-477a-a6d8-98737020e4be tempest-GroupsV320Test-82153897 None] Group tempest-GroupsV320Test-Group-1407902594: creating Jul 01 06:47:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-65b3b746-acc8-477a-a6d8-98737020e4be tempest-GroupsV320Test-82153897 None] Group tempest-GroupsV320Test-Group-1407902594: created successfully Jul 01 06:47:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-65b3b746-acc8-477a-a6d8-98737020e4be tempest-GroupsV320Test-82153897 None] Create group completed successfully. Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Created reservations ['1f35b4ff-8a42-44ec-8b12-1da82987d567'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:47:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:47:51 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:47:51 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:47:52 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 01 06:47:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:47:52 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:47:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9f42f3df-a3e1-4fd2-a41f-28e2f87d0fc9 tempest-GroupsV320Test-82153897 None] Delete group completed successfully. Jul 01 06:48:01 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=35,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:48:01 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=37,cinder:SELECT=35,cinder:INSERT=8 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Flow 'volume_create_manager' (fc1732d2-0b7a-44be-8bfb-4fcfe4ccb0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed40accc-0cf2-4a45-9a27-c9ceda88b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed40accc-0cf2-4a45-9a27-c9ceda88b257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1308851714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3975f805-6fc6-4b93-b660-3a3d94cb2be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a061338a0f4c00b8bb34a7f1adc688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:17Z,use_quota=True,user_id='3a3bbf5a0b71406ab0aba97b42b22c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28121788-53c0-40ae-aa11-e26347f4a991),volume_type_id=28121788-53c0-40ae-aa11-e26347f4a991)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe738b1-5347-48d2-8587-a5e443ff39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe738b1-5347-48d2-8587-a5e443ff39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df07967-be5f-4a9f-822b-99515bd64a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df07967-be5f-4a9f-822b-99515bd64a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3975f805-6fc6-4b93-b660-3a3d94cb2be7', 'volume_name': 'volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77fab95-2b8a-4a1c-ab7a-00a3c87ccd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77fab95-2b8a-4a1c-ab7a-00a3c87ccd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1237c5db-ce6c-48c2-afbc-cc15a6c22671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Volume 3975f805-6fc6-4b93-b660-3a3d94cb2be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7', 'volume_size': 1} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1308851714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3975f805-6fc6-4b93-b660-3a3d94cb2be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a061338a0f4c00b8bb34a7f1adc688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:17Z,use_quota=True,user_id='3a3bbf5a0b71406ab0aba97b42b22c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28121788-53c0-40ae-aa11-e26347f4a991),volume_type_id=28121788-53c0-40ae-aa11-e26347f4a991)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Creating volume 3975f805-6fc6-4b93-b660-3a3d94cb2be7 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:17 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:17 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 1073741824 Jul 01 06:48:17 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:18 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 1073741824" returned: 0 in 1.049s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:18 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 Jul 01 06:48:18 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:19 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7" returned: 0 in 0.732s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1237c5db-ce6c-48c2-afbc-cc15a6c22671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665f9bac-f8b1-4666-a80e-327646806b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Volume volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 (3975f805-6fc6-4b93-b660-3a3d94cb2be7): created successfully Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665f9bac-f8b1-4666-a80e-327646806b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Flow 'volume_create_manager' (fc1732d2-0b7a-44be-8bfb-4fcfe4ccb0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-bfccccee-e0f2-4090-bd0c-644dd6948048 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Created volume successfully. Jul 01 06:48:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:20 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:48:20 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:21 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.069s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:21 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:48:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-09582068-1d99-4f12-8536-a0fbd3497dcc tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Retype volume completed successfully. Jul 01 06:48:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Acquiring lock "cinder-3975f805-6fc6-4b93-b660-3a3d94cb2be7-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "cinder-3975f805-6fc6-4b93-b660-3a3d94cb2be7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Acquiring lock "cinder-quobyte-3975f805-6fc6-4b93-b660-3a3d94cb2be7" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "cinder-quobyte-3975f805-6fc6-4b93-b660-3a3d94cb2be7" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:22 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f63dd9-2c43-4070-959f-e5a8759c27a5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:48:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:22 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 Jul 01 06:48:22 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:24 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7" returned: 0 in 1.988s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:24 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7 Jul 01 06:48:24 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:25 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3975f805-6fc6-4b93-b660-3a3d94cb2be7" returned: 0 in 1.266s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "cinder-quobyte-3975f805-6fc6-4b93-b660-3a3d94cb2be7" released by "delete_volume" :: held 3.344s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:25 devstack cinder-volume[86219]: WARNING cinder.quota [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:48:25 devstack cinder-volume[86219]: WARNING cinder.quota [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:48:25 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Created reservations ['d9ec0c91-1da0-44c7-af25-8c05ecf4b02c', 'cd32c8da-3e11-4997-a3e6-27b47d9f0556', '527224ea-501c-4137-b159-f350840183d4', '7f80a753-e45f-4320-8128-ba31606422e9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:26 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:48:26 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:26 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:48:26 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (d70b3b6f-f683-437e-9dbe-8e370ce1769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77340912-6cd4-432c-8cc7-ba6e20f4098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77340912-6cd4-432c-8cc7-ba6e20f4098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-454205474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da82633a-3baf-4ebe-956f-34f8f9c88316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:28Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ba959f-9745-4d1a-abf4-21299e820fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ba959f-9745-4d1a-abf4-21299e820fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffe50a7-0f5d-4f46-b65c-142d76110148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffe50a7-0f5d-4f46-b65c-142d76110148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da82633a-3baf-4ebe-956f-34f8f9c88316', 'volume_name': 'volume-da82633a-3baf-4ebe-956f-34f8f9c88316', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d4e85d-5f58-40b0-bfe1-a97a5bd5ccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d4e85d-5f58-40b0-bfe1-a97a5bd5ccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7cd1a3-31fc-40ad-9fb3-ff3644fabe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:28 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Volume da82633a-3baf-4ebe-956f-34f8f9c88316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da82633a-3baf-4ebe-956f-34f8f9c88316', 'volume_size': 1} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-454205474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da82633a-3baf-4ebe-956f-34f8f9c88316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:28Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Creating volume da82633a-3baf-4ebe-956f-34f8f9c88316 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:28 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:28 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 1073741824 Jul 01 06:48:28 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:28 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.955s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 8 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:48:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:48:29 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 3.267s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:29 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:48:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Deleted volume successfully. Jul 01 06:48:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d6183c30-98ab-4743-b195-01bfa3038dd0 tempest-VolumeRetypeWithoutMigrationTest-323936193 None] Lock "cinder-3975f805-6fc6-4b93-b660-3a3d94cb2be7-delete_volume" released by "delete_volume" :: held 7.267s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:30 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 1073741824" returned: 0 in 1.951s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:30 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 Jul 01 06:48:30 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:32 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316" returned: 0 in 1.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] <== create_volume: return (3959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.967s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7cd1a3-31fc-40ad-9fb3-ff3644fabe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da82633a-3baf-4ebe-956f-34f8f9c88316', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea6b870-7411-47fb-a203-105b35615b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:32 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Volume volume-da82633a-3baf-4ebe-956f-34f8f9c88316 (da82633a-3baf-4ebe-956f-34f8f9c88316): created successfully Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea6b870-7411-47fb-a203-105b35615b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (d70b3b6f-f683-437e-9dbe-8e370ce1769c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-880a88e0-5a0c-4a2f-aac7-c442e5a79ff5 tempest-VolumesActionsTest-1448669804 None] Created volume successfully. Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-37fc8bcf-3fb7-402b-bbb3-112d130af58a tempest-VolumesActionsTest-1448669804 None] Acquiring lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316" by "attach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-37fc8bcf-3fb7-402b-bbb3-112d130af58a tempest-VolumesActionsTest-1448669804 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316" acquired by "attach_volume" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-37fc8bcf-3fb7-402b-bbb3-112d130af58a tempest-VolumesActionsTest-1448669804 None] Attaching volume da82633a-3baf-4ebe-956f-34f8f9c88316 to instance 9ad32cc5-3716-4a96-add3-4a708a8c918e at mountpoint /dev/vdb on host None. Jul 01 06:48:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-37fc8bcf-3fb7-402b-bbb3-112d130af58a tempest-VolumesActionsTest-1448669804 None] Attach volume completed successfully. Jul 01 06:48:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-37fc8bcf-3fb7-402b-bbb3-112d130af58a tempest-VolumesActionsTest-1448669804 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316" released by "attach_volume" :: held 0.236s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-66fdb08c-d7fb-4ede-9a9d-f8afe2dbb895 tempest-VolumesActionsTest-149576603 None] Terminate volume connection completed successfully. Jul 01 06:48:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-66fdb08c-d7fb-4ede-9a9d-f8afe2dbb895 tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-detach_volume" by "detach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-66fdb08c-d7fb-4ede-9a9d-f8afe2dbb895 tempest-VolumesActionsTest-149576603 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-66fdb08c-d7fb-4ede-9a9d-f8afe2dbb895 tempest-VolumesActionsTest-149576603 None] Detaching volume da82633a-3baf-4ebe-956f-34f8f9c88316 from instance 9ad32cc5-3716-4a96-add3-4a708a8c918e. Jul 01 06:48:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-66fdb08c-d7fb-4ede-9a9d-f8afe2dbb895 tempest-VolumesActionsTest-149576603 None] Detach volume completed successfully. Jul 01 06:48:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-66fdb08c-d7fb-4ede-9a9d-f8afe2dbb895 tempest-VolumesActionsTest-149576603 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-detach_volume" released by "detach_volume" :: held 0.213s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-69131afe-cadd-452b-a21f-f173bad0115f tempest-VolumesActionsTest-1448669804 None] Acquiring lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-detach_volume" by "detach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-69131afe-cadd-452b-a21f-f173bad0115f tempest-VolumesActionsTest-1448669804 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-69131afe-cadd-452b-a21f-f173bad0115f tempest-VolumesActionsTest-1448669804 None] Volume detach called, but volume not attached. Jul 01 06:48:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-69131afe-cadd-452b-a21f-f173bad0115f tempest-VolumesActionsTest-1448669804 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "cinder-quobyte-da82633a-3baf-4ebe-956f-34f8f9c88316" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-quobyte-da82633a-3baf-4ebe-956f-34f8f9c88316" acquired by "delete_volume" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:37 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e3f5cc-5796-4c60-88ed-9b4a52dd7264]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:48:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:37 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 Jul 01 06:48:37 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:38 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316" returned: 0 in 1.415s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:38 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316 Jul 01 06:48:38 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:39 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-da82633a-3baf-4ebe-956f-34f8f9c88316" returned: 0 in 1.105s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-quobyte-da82633a-3baf-4ebe-956f-34f8f9c88316" released by "delete_volume" :: held 2.635s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:39 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Created reservations ['f2082102-f25a-404e-939a-93ade612d132', '4eefdd8c-aaa4-4876-85bb-0509d488a46f', '63b010d8-b148-40aa-b952-2c0ddf6b786c', '32dcdc45-62ad-4e1a-9129-f7980c0c7414'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:48:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:40 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:48:40 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:40 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.934s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:40 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:48:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Deleted volume successfully. Jul 01 06:48:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-23f8ff6e-7dea-4247-8109-e776b7c73833 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-da82633a-3baf-4ebe-956f-34f8f9c88316-delete_volume" released by "delete_volume" :: held 4.015s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Flow 'volume_create_manager' (94b8e3fa-4fc6-4d47-a737-c94f5da9b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec2307a-f41b-438b-9a2c-b6f4fd2010e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec2307a-f41b-438b-9a2c-b6f4fd2010e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1381626237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47eb86ff-2411-4402-b016-f0a076c43c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d0027f9d70498cb6e7bccc92f63294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:47Z,use_quota=True,user_id='899bc774bc5d43cdb7960b7d3d44a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ec72a3-aa3d-471f-972a-837bcf45a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ec72a3-aa3d-471f-972a-837bcf45a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d94530-1669-494a-8ff2-d51d710ea3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d94530-1669-494a-8ff2-d51d710ea3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47eb86ff-2411-4402-b016-f0a076c43c25', 'volume_name': 'volume-47eb86ff-2411-4402-b016-f0a076c43c25', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1498141-45ff-479e-bac2-63e687b5b558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1498141-45ff-479e-bac2-63e687b5b558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8648f1c5-e008-4a9c-a7a0-1bbf8d84b4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:47 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Volume 47eb86ff-2411-4402-b016-f0a076c43c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47eb86ff-2411-4402-b016-f0a076c43c25', 'volume_size': 1} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1381626237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47eb86ff-2411-4402-b016-f0a076c43c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d0027f9d70498cb6e7bccc92f63294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:47Z,use_quota=True,user_id='899bc774bc5d43cdb7960b7d3d44a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Creating volume 47eb86ff-2411-4402-b016-f0a076c43c25 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:47 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:47 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 1073741824 Jul 01 06:48:47 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:48 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 1073741824" returned: 0 in 0.857s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:48 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 Jul 01 06:48:48 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (e6454b5d-132e-4a97-9aa1-b44c21c318ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a469a65-f8f0-4824-bae3-7be520419067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a469a65-f8f0-4824-bae3-7be520419067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076269774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8aa7111-7f25-4920-bd44-80f1343c5155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:49Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66996ba9-67ae-4041-bb41-8a57a527d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66996ba9-67ae-4041-bb41-8a57a527d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff5d60-cd12-47b0-8f3e-b8c27ef8abbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff5d60-cd12-47b0-8f3e-b8c27ef8abbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8aa7111-7f25-4920-bd44-80f1343c5155', 'volume_name': 'volume-d8aa7111-7f25-4920-bd44-80f1343c5155', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb578a0-1333-4426-b342-044cd0dca862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb578a0-1333-4426-b342-044cd0dca862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a830e3b1-05d9-4854-9276-84e52b176e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Volume d8aa7111-7f25-4920-bd44-80f1343c5155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8aa7111-7f25-4920-bd44-80f1343c5155', 'volume_size': 1} Jul 01 06:48:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:49 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25" returned: 0 in 0.678s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076269774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8aa7111-7f25-4920-bd44-80f1343c5155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:49Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Creating volume d8aa7111-7f25-4920-bd44-80f1343c5155 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:49 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8648f1c5-e008-4a9c-a7a0-1bbf8d84b4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47eb86ff-2411-4402-b016-f0a076c43c25', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:49 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 1073741824 Jul 01 06:48:49 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98306024-8bea-4f10-9320-63091eeaad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:49 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Volume volume-47eb86ff-2411-4402-b016-f0a076c43c25 (47eb86ff-2411-4402-b016-f0a076c43c25): created successfully Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98306024-8bea-4f10-9320-63091eeaad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Flow 'volume_create_manager' (94b8e3fa-4fc6-4d47-a737-c94f5da9b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-60216071-75ad-440a-9e86-ab5257d39fa4 tempest-VolumesListAdminTestJSON-142074666 None] Created volume successfully. Jul 01 06:48:50 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 1073741824" returned: 0 in 0.959s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Flow 'volume_create_manager' (42ba15af-8b11-4d55-94ad-44655de4df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9199ac30-cb99-4776-8cdb-a5fbff08cdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9199ac30-cb99-4776-8cdb-a5fbff08cdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-596358395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d0027f9d70498cb6e7bccc92f63294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:50Z,use_quota=True,user_id='899bc774bc5d43cdb7960b7d3d44a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a10910-ad25-4928-b55b-ef41ec51ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a10910-ad25-4928-b55b-ef41ec51ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda04b5-8490-4558-9e1b-b75c3341da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda04b5-8490-4558-9e1b-b75c3341da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e', 'volume_name': 'volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd03a1d-69f2-4c1f-8f0e-7f38fde7e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd03a1d-69f2-4c1f-8f0e-7f38fde7e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5f9030-3e22-476a-b783-3d15dae48ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:50 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Volume f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e', 'volume_size': 1} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:50 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 Jul 01 06:48:50 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:50 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155" returned: 0 in 0.728s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-596358395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d0027f9d70498cb6e7bccc92f63294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:50Z,use_quota=True,user_id='899bc774bc5d43cdb7960b7d3d44a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Creating volume f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:50 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:51 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e 1073741824 Jul 01 06:48:51 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a830e3b1-05d9-4854-9276-84e52b176e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8aa7111-7f25-4920-bd44-80f1343c5155', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efe8dc6-f0d4-4341-b6cd-76125d2608db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Volume volume-d8aa7111-7f25-4920-bd44-80f1343c5155 (d8aa7111-7f25-4920-bd44-80f1343c5155): created successfully Jul 01 06:48:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efe8dc6-f0d4-4341-b6cd-76125d2608db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (e6454b5d-132e-4a97-9aa1-b44c21c318ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e2a70dac-5149-4526-8f04-09413e9010fc tempest-VolumesActionsTest-1448669804 None] Created volume successfully. Jul 01 06:48:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-d8aa7111-7f25-4920-bd44-80f1343c5155-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Lock "cinder-d8aa7111-7f25-4920-bd44-80f1343c5155-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-quobyte-d8aa7111-7f25-4920-bd44-80f1343c5155" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-d8aa7111-7f25-4920-bd44-80f1343c5155" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f782ab6-9ffc-4a3a-b047-2d2709d92419]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:52 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e 1073741824" returned: 0 in 1.146s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:52 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e Jul 01 06:48:52 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:52 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 Jul 01 06:48:52 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:52 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e" returned: 0 in 0.738s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5f9030-3e22-476a-b783-3d15dae48ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c911a74-5a88-4aa6-b928-2b69593e09a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:52 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Volume volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e (f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e): created successfully Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c911a74-5a88-4aa6-b928-2b69593e09a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Flow 'volume_create_manager' (42ba15af-8b11-4d55-94ad-44655de4df51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1c279153-cbd4-4104-84d6-63cf073740c1 tempest-VolumesListAdminTestJSON-142074666 None] Created volume successfully. Jul 01 06:48:53 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155" returned: 0 in 1.027s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:53 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155 Jul 01 06:48:53 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Flow 'volume_create_manager' (5f0e59cf-67de-4200-b6d3-bcf75f65ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60636018-2070-4883-9026-220e259a4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60636018-2070-4883-9026-220e259a4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1669240097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff1c5c3-6bc1-4f82-b416-3415270c5d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cee47b791d4be081e92dfca7bd4ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:53Z,use_quota=True,user_id='a956a081a55944d69781d3aa3038994c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688b219f-a8ef-4e85-b38e-dc7d61f136b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688b219f-a8ef-4e85-b38e-dc7d61f136b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7154bdcc-2c98-43b0-9331-092e079f456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7154bdcc-2c98-43b0-9331-092e079f456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff1c5c3-6bc1-4f82-b416-3415270c5d37', 'volume_name': 'volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f52f59a-b45b-42f9-9edd-f6a01e6366ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f52f59a-b45b-42f9-9edd-f6a01e6366ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ffdb4d-0151-4792-ba67-6b7ba2dabaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Volume 0ff1c5c3-6bc1-4f82-b416-3415270c5d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37', 'volume_size': 1} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1669240097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff1c5c3-6bc1-4f82-b416-3415270c5d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cee47b791d4be081e92dfca7bd4ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:53Z,use_quota=True,user_id='a956a081a55944d69781d3aa3038994c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Creating volume 0ff1c5c3-6bc1-4f82-b416-3415270c5d37 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:53 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:53 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 1073741824 Jul 01 06:48:53 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Flow 'volume_create_manager' (8d1051be-0508-4ef3-a630-fbdabdd4ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5fb147-54ed-4a48-b125-c24df1b61d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d8aa7111-7f25-4920-bd44-80f1343c5155" returned: 0 in 0.853s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5fb147-54ed-4a48-b125-c24df1b61d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1222057083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7202ede-be77-403f-a2b9-3a1693bd2b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d0027f9d70498cb6e7bccc92f63294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:54Z,use_quota=True,user_id='899bc774bc5d43cdb7960b7d3d44a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66873d37-b37d-4be8-b97d-2db9d662bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66873d37-b37d-4be8-b97d-2db9d662bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848bc538-f3dc-4a03-b265-76b17ac268cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848bc538-f3dc-4a03-b265-76b17ac268cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7202ede-be77-403f-a2b9-3a1693bd2b7a', 'volume_name': 'volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abccc33-8a71-4889-9d8e-130d97f70b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abccc33-8a71-4889-9d8e-130d97f70b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45386178-2bb9-4bbe-ac86-cbb78d0b105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:54 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Volume d7202ede-be77-403f-a2b9-3a1693bd2b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a', 'volume_size': 1} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-d8aa7111-7f25-4920-bd44-80f1343c5155" released by "delete_volume" :: held 1.984s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Created reservations ['da3c4f94-9a14-4029-adb3-95084a0035ab', '47ab1f1e-6f87-406a-b6f9-add09586ee68', '05d8b69a-4e5c-497e-869d-e49bcb11fddf', '3180ab0d-242f-47ad-b92b-533af8d7e730'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:54 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:48:54 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:54 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 1073741824" returned: 0 in 1.188s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:54 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 Jul 01 06:48:54 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:54 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:48:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Deleted volume successfully. Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (e2e24e6c-5d01-4f05-a6c8-3a8145602d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904a2fb4-c017-4528-9e4d-252f23ef9f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-741d5deb-be65-45b8-915e-c5937f6749ea tempest-VolumesActionsTest-149576603 None] Lock "cinder-d8aa7111-7f25-4920-bd44-80f1343c5155-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904a2fb4-c017-4528-9e4d-252f23ef9f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-305632919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739dbae0-d570-48b8-adb5-9324cf06a069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:55Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1269638a-10de-4cd4-b87b-e0ace0969195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1269638a-10de-4cd4-b87b-e0ace0969195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a78027-e0cd-406d-b38c-81d1da5f0186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a78027-e0cd-406d-b38c-81d1da5f0186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739dbae0-d570-48b8-adb5-9324cf06a069', 'volume_name': 'volume-739dbae0-d570-48b8-adb5-9324cf06a069', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff993d61-541b-4a0f-8b19-9b12b800b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff993d61-541b-4a0f-8b19-9b12b800b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5387d6e4-a020-482a-a7bc-2f4964688521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:55 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Volume 739dbae0-d570-48b8-adb5-9324cf06a069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739dbae0-d570-48b8-adb5-9324cf06a069', 'volume_size': 1} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:55 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" returned: 0 in 0.671s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1222057083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7202ede-be77-403f-a2b9-3a1693bd2b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d0027f9d70498cb6e7bccc92f63294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:54Z,use_quota=True,user_id='899bc774bc5d43cdb7960b7d3d44a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Creating volume d7202ede-be77-403f-a2b9-3a1693bd2b7a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:55 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ffdb4d-0151-4792-ba67-6b7ba2dabaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:55 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a 1073741824 Jul 01 06:48:55 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bc97d4-261c-46eb-b39c-37f2a309724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:55 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Volume volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 (0ff1c5c3-6bc1-4f82-b416-3415270c5d37): created successfully Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bc97d4-261c-46eb-b39c-37f2a309724c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Flow 'volume_create_manager' (5f0e59cf-67de-4200-b6d3-bcf75f65ea73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f6b82761-0512-41a8-bda1-2692846eed51 tempest-AttachVolumeNegativeTest-757293942 None] Created volume successfully. Jul 01 06:48:56 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a 1073741824" returned: 0 in 0.850s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:56 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a Jul 01 06:48:56 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Flow 'volume_create_manager' (ca08b86d-1b5c-476a-bfaf-9079bb7440ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ee8762-e42c-40fd-bd25-7f9a2bab4e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ee8762-e42c-40fd-bd25-7f9a2bab4e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-631303026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f060e32d-1806-4664-bc51-c34d293cc11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f2834707344c3a89e14292ed4b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:57Z,use_quota=True,user_id='a99027a1a4654ef1a76087da64dcf44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a535c155-c61c-4757-940f-43eb0798654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a535c155-c61c-4757-940f-43eb0798654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8dd1c5-76e2-4d17-a063-0a0c3ce96275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8dd1c5-76e2-4d17-a063-0a0c3ce96275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f060e32d-1806-4664-bc51-c34d293cc11d', 'volume_name': 'volume-f060e32d-1806-4664-bc51-c34d293cc11d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8798d7ec-e84d-430a-a263-75527e7717ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8798d7ec-e84d-430a-a263-75527e7717ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd898f8-c380-4d6b-bc25-6a319159d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Volume f060e32d-1806-4664-bc51-c34d293cc11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f060e32d-1806-4664-bc51-c34d293cc11d', 'volume_size': 1} Jul 01 06:48:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:57 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-305632919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739dbae0-d570-48b8-adb5-9324cf06a069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:55Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Creating volume 739dbae0-d570-48b8-adb5-9324cf06a069 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:57 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:57 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 1073741824 Jul 01 06:48:57 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45386178-2bb9-4bbe-ac86-cbb78d0b105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56230d1-6c4e-4eba-95cf-8d3a51865971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Volume volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a (d7202ede-be77-403f-a2b9-3a1693bd2b7a): created successfully Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56230d1-6c4e-4eba-95cf-8d3a51865971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Flow 'volume_create_manager' (8d1051be-0508-4ef3-a630-fbdabdd4ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-eafc8b97-7a60-4741-b170-5105dae0a708 tempest-VolumesListAdminTestJSON-142074666 None] Created volume successfully. Jul 01 06:48:57 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 1073741824" returned: 0 in 0.825s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:57 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 Jul 01 06:48:57 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:58 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069" returned: 0 in 0.719s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-631303026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f060e32d-1806-4664-bc51-c34d293cc11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f2834707344c3a89e14292ed4b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:57Z,use_quota=True,user_id='a99027a1a4654ef1a76087da64dcf44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Creating volume f060e32d-1806-4664-bc51-c34d293cc11d {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:48:58 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:58 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d 1073741824 Jul 01 06:48:58 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5387d6e4-a020-482a-a7bc-2f4964688521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739dbae0-d570-48b8-adb5-9324cf06a069', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb177b5-7259-4e21-935d-b466ac7e3d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Volume volume-739dbae0-d570-48b8-adb5-9324cf06a069 (739dbae0-d570-48b8-adb5-9324cf06a069): created successfully Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb177b5-7259-4e21-935d-b466ac7e3d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (e2e24e6c-5d01-4f05-a6c8-3a8145602d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2f43689d-83a1-43d6-9c8e-800c6c428373 tempest-VolumesActionsTest-1448669804 None] Created volume successfully. Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Flow 'volume_create_manager' (026e4b9e-0857-43ae-bf04-3fbb42ea2cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3f967d-3f31-4877-9654-816804cd883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3f967d-3f31-4877-9654-816804cd883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff74d92e-f816-4f57-bf40-3bfdf120040f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c920a4b4ea40fab1af2f6f59f6cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:59Z,use_quota=True,user_id='31bc07904dd5434db38cd05546f6c4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3f502c-c035-4e8a-ad9b-11f257f758a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3f502c-c035-4e8a-ad9b-11f257f758a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cddd3d-62fb-4803-831b-42994e47f4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cddd3d-62fb-4803-831b-42994e47f4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff74d92e-f816-4f57-bf40-3bfdf120040f', 'volume_name': 'volume-ff74d92e-f816-4f57-bf40-3bfdf120040f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3433f947-7569-42a2-b0a4-e72354cc36c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3433f947-7569-42a2-b0a4-e72354cc36c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f125346d-8ad9-46f6-9861-4f0a34a73afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:48:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Volume ff74d92e-f816-4f57-bf40-3bfdf120040f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff74d92e-f816-4f57-bf40-3bfdf120040f', 'volume_size': 1} Jul 01 06:48:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-739dbae0-d570-48b8-adb5-9324cf06a069-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Lock "cinder-739dbae0-d570-48b8-adb5-9324cf06a069-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-quobyte-739dbae0-d570-48b8-adb5-9324cf06a069" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-739dbae0-d570-48b8-adb5-9324cf06a069" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f2eb4-46a5-48e2-9619-562e6f41fd44]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:59 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 Jul 01 06:48:59 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:59 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d 1073741824" returned: 0 in 0.982s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:48:59 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d Jul 01 06:48:59 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:48:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:00 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069" returned: 0 in 0.833s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:00 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069 Jul 01 06:49:00 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:00 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d" returned: 0 in 0.678s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff74d92e-f816-4f57-bf40-3bfdf120040f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c920a4b4ea40fab1af2f6f59f6cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:48:59Z,use_quota=True,user_id='31bc07904dd5434db38cd05546f6c4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Creating volume ff74d92e-f816-4f57-bf40-3bfdf120040f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:00 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd898f8-c380-4d6b-bc25-6a319159d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f060e32d-1806-4664-bc51-c34d293cc11d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:00 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f 1073741824 Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca26e5d-b1d3-410b-9030-75af055a5db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:00 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:00 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Volume volume-f060e32d-1806-4664-bc51-c34d293cc11d (f060e32d-1806-4664-bc51-c34d293cc11d): created successfully Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca26e5d-b1d3-410b-9030-75af055a5db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Flow 'volume_create_manager' (ca08b86d-1b5c-476a-bfaf-9079bb7440ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:00 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-6dcd3518-7bf3-4327-b255-dd102c0ad74e tempest-AttachVolumeTestJSON-1369393165 None] Created volume successfully. Jul 01 06:49:00 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-739dbae0-d570-48b8-adb5-9324cf06a069" returned: 0 in 0.713s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-739dbae0-d570-48b8-adb5-9324cf06a069" released by "delete_volume" :: held 1.601s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Created reservations ['256223a3-255c-4c02-a616-a6bbbdca5b6d', 'c1246acf-9a66-4133-bbbc-474106700a34', '875859bf-a9ee-483d-99b6-168d468e85bc', '7196f2db-0420-46ba-89b6-33fe1d2b9f1f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:01 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:01 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:01 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f 1073741824" returned: 0 in 0.915s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:01 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f Jul 01 06:49:01 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:01 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.700s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Deleted volume successfully. Jul 01 06:49:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52097c24-82a9-415a-9d46-6d123a9388fa tempest-VolumesActionsTest-149576603 None] Lock "cinder-739dbae0-d570-48b8-adb5-9324cf06a069-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:02 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f" returned: 0 in 0.705s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.310s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3950340c-1ed7-44e9-86b6-e1406be4fc72]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f125346d-8ad9-46f6-9861-4f0a34a73afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff74d92e-f816-4f57-bf40-3bfdf120040f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1523f6-d080-4c9c-a9b9-453f2771c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:02 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Volume volume-ff74d92e-f816-4f57-bf40-3bfdf120040f (ff74d92e-f816-4f57-bf40-3bfdf120040f): created successfully Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1523f6-d080-4c9c-a9b9-453f2771c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Flow 'volume_create_manager' (026e4b9e-0857-43ae-bf04-3fbb42ea2cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3094816d-8845-41bb-ac2d-d6bd93f0f1cd tempest-VolumesListAdminTestJSON-626543208 None] Created volume successfully. Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:02 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 Jul 01 06:49:02 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (e3770c32-d53c-4042-abf0-3398117bee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2ef351-a940-4785-a68b-3868afe32d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2ef351-a940-4785-a68b-3868afe32d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749966827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0bbd62-469b-49c9-88c9-c42b5824b71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:02Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b9e657-e798-4cdb-aed7-73a44b39a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b9e657-e798-4cdb-aed7-73a44b39a121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331f2542-35dc-4985-a7c0-1f5802a29818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331f2542-35dc-4985-a7c0-1f5802a29818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0bbd62-469b-49c9-88c9-c42b5824b71f', 'volume_name': 'volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2241ffa-6206-4925-ba68-907d18a4b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2241ffa-6206-4925-ba68-907d18a4b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2f62f9-0a31-4a08-b34d-1aa12056bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:02 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Volume 7e0bbd62-469b-49c9-88c9-c42b5824b71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f', 'volume_size': 1} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:02 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" returned: 0 in 0.786s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749966827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0bbd62-469b-49c9-88c9-c42b5824b71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:02Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Creating volume 7e0bbd62-469b-49c9-88c9-c42b5824b71f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:02 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:02 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f 1073741824 Jul 01 06:49:02 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c72e2eb-b7ae-4e73-a020-864243e9620e', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:49:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-6da79996-5bdc-45af-8c12-946a18afa63d req-946b419a-1664-4fb8-9b18-e3faeaea3573 tempest-AttachVolumeNegativeTest-757293942 None] attachment_update completed successfully. Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Acquiring lock "cinder-ff74d92e-f816-4f57-bf40-3bfdf120040f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Lock "cinder-ff74d92e-f816-4f57-bf40-3bfdf120040f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Acquiring lock "cinder-quobyte-ff74d92e-f816-4f57-bf40-3bfdf120040f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Lock "cinder-quobyte-ff74d92e-f816-4f57-bf40-3bfdf120040f" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[44585f33-25aa-4896-a21e-19a8d70eedca]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "cinder-d7202ede-be77-403f-a2b9-3a1693bd2b7a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-d7202ede-be77-403f-a2b9-3a1693bd2b7a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "cinder-quobyte-d7202ede-be77-403f-a2b9-3a1693bd2b7a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:03 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f Jul 01 06:49:03 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-quobyte-d7202ede-be77-403f-a2b9-3a1693bd2b7a" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb401ce-6b7f-4656-b68b-7fbd8d9e5531]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:03 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a Jul 01 06:49:03 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:03 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f 1073741824" returned: 0 in 1.118s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:04 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f Jul 01 06:49:04 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:04 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f" returned: 0 in 0.934s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:04 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f Jul 01 06:49:04 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:04 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a" returned: 0 in 0.934s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:04 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a Jul 01 06:49:04 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:04 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f" returned: 0 in 0.751s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.813s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2f62f9-0a31-4a08-b34d-1aa12056bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91978eec-2462-4f1d-964f-b2386ae63f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e28ed0-f3aa-40f7-b564-04d88f1969d7]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:04 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Volume volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f (7e0bbd62-469b-49c9-88c9-c42b5824b71f): created successfully Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91978eec-2462-4f1d-964f-b2386ae63f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (e3770c32-d53c-4042-abf0-3398117bee2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:04 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e7289c5e-c687-452a-9a26-2abce3f8e922 tempest-VolumesActionsTest-1448669804 None] Created volume successfully. Jul 01 06:49:04 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d Jul 01 06:49:04 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:05 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ff74d92e-f816-4f57-bf40-3bfdf120040f" returned: 0 in 0.716s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Lock "cinder-quobyte-ff74d92e-f816-4f57-bf40-3bfdf120040f" released by "delete_volume" :: held 1.734s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Created reservations ['1356b3bc-0ed9-4a65-8c0b-b5dce2fc65ea', 'db95fa1c-6cb4-4151-ab39-dfc181b5f149', 'c58f31d3-2e13-4085-9c9e-10c3538e191c', '1485c906-7d36-4599-8faa-5d7ae7e33415'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:05 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:05 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:05 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7202ede-be77-403f-a2b9-3a1693bd2b7a" returned: 0 in 0.731s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-quobyte-d7202ede-be77-403f-a2b9-3a1693bd2b7a" released by "delete_volume" :: held 1.742s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Created reservations ['05e19858-7ef2-431e-8096-3398dd969562', '3932d169-6751-498e-be6e-8a849172ab17', 'f777e11d-be31-4981-8345-904579dfba27', '6e34a51b-704e-44ff-95ba-10999321a6ea'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:05 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:05 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-7e0bbd62-469b-49c9-88c9-c42b5824b71f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Lock "cinder-7e0bbd62-469b-49c9-88c9-c42b5824b71f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:05 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d" returned: 0 in 0.988s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.022s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-quobyte-7e0bbd62-469b-49c9-88c9-c42b5824b71f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-f060e32d-1806-4664-bc51-c34d293cc11d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50220575-1b49-4a0e-bc48-8e9462b9ea60', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-7e0bbd62-469b-49c9-88c9-c42b5824b71f" acquired by "delete_volume" :: waited 0.063s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[08edd263-7975-4082-b109-7635a9b91b53]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:05 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-7d85e432-20f7-4e6c-8bc8-75f39ee47020 req-832cdcf9-8659-4b87-a38d-a932e769c200 tempest-AttachVolumeTestJSON-1369393165 None] attachment_update completed successfully. Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "cinder-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "cinder-quobyte-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-quobyte-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe6f54d-dd28-4973-a69a-47eabc7da497]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:06 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f Jul 01 06:49:06 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:06 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:06 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e Jul 01 06:49:06 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.883s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Deleted volume successfully. Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f3c319bd-eb82-4c43-a2c7-121df3965da2 tempest-VolumesListAdminTestJSON-626543208 None] Lock "cinder-ff74d92e-f816-4f57-bf40-3bfdf120040f-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:06 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.892s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Deleted volume successfully. Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52d7cf8a-5ca6-44c9-99e0-6640a96f62a5 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-d7202ede-be77-403f-a2b9-3a1693bd2b7a-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:06 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f" returned: 0 in 0.945s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:06 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f Jul 01 06:49:06 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:07 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e" returned: 0 in 0.891s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:07 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e Jul 01 06:49:07 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:07 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e0bbd62-469b-49c9-88c9-c42b5824b71f" returned: 0 in 0.679s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-7e0bbd62-469b-49c9-88c9-c42b5824b71f" released by "delete_volume" :: held 1.682s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Created reservations ['fea5c84d-d309-4040-84f7-2d97815f0329', '8971f612-157a-4dc0-aa79-b21de41e83bd', '8c3975ae-0d8e-42ee-bf4d-7e018fd3a7d4', 'e4aaae7f-3a81-44b4-95c5-265d2013ac1e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:07 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e" returned: 0 in 0.705s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-quobyte-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e" released by "delete_volume" :: held 1.653s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:07 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:07 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Created reservations ['43740ea0-7537-4eb0-834c-ecd7d5266162', '66b1c266-af91-4c99-9960-abd415ef3167', 'd14f0ae0-6ac5-4f63-99a1-bd82b1803f27', '5b32c92d-6b77-4ffa-85b4-f76631a2fa82'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:07 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:07 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "cinder-47eb86ff-2411-4402-b016-f0a076c43c25-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-47eb86ff-2411-4402-b016-f0a076c43c25-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "cinder-quobyte-47eb86ff-2411-4402-b016-f0a076c43c25" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:08 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-quobyte-47eb86ff-2411-4402-b016-f0a076c43c25" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.945s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Deleted volume successfully. Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9b37b-c835-4b7b-af81-c09be17b45ad]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:08 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.903s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-28316804-d03c-4462-ac3e-76ac2ed7ed73 tempest-VolumesActionsTest-149576603 None] Lock "cinder-7e0bbd62-469b-49c9-88c9-c42b5824b71f-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Deleted volume successfully. Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3ab6a6db-994c-42d4-9870-395c48ca0a21 tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-f5db2fd4-5d3c-41b1-9b70-dd1d6a13d76e-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (9bccf5b4-2e12-42ad-87d2-369e6accb320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442257c3-70a1-40ce-a6db-a5edad1385ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442257c3-70a1-40ce-a6db-a5edad1385ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2084631314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5b5b64-d587-45cb-907f-580887a148d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:09Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:08 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 Jul 01 06:49:08 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fdf0d1-1f98-4fab-b950-02092b0535e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fdf0d1-1f98-4fab-b950-02092b0535e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b323490-2e2f-403d-8cb7-0579bac7d781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b323490-2e2f-403d-8cb7-0579bac7d781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5b5b64-d587-45cb-907f-580887a148d1', 'volume_name': 'volume-3c5b5b64-d587-45cb-907f-580887a148d1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a5a3d5-f136-4f67-bc65-5f4c8bdc7aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a5a3d5-f136-4f67-bc65-5f4c8bdc7aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92347c06-55ac-4b06-b3c3-76934abf120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:08 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Volume 3c5b5b64-d587-45cb-907f-580887a148d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5b5b64-d587-45cb-907f-580887a148d1', 'volume_size': 1} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2084631314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5b5b64-d587-45cb-907f-580887a148d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:09Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Creating volume 3c5b5b64-d587-45cb-907f-580887a148d1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:08 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:08 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 1073741824 Jul 01 06:49:08 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:09 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25" returned: 0 in 0.833s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:09 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25 Jul 01 06:49:09 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:09 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 1073741824" returned: 0 in 0.958s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:09 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 Jul 01 06:49:09 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-4b0f3fd1-bb84-4fa5-809b-6f5bd4a8ccd3 req-6bfaae20-6987-4eeb-8b5f-3fac9cc36800 tempest-AttachVolumeNegativeTest-757293942 None] Terminate volume connection completed successfully. Jul 01 06:49:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-4b0f3fd1-bb84-4fa5-809b-6f5bd4a8ccd3 req-6bfaae20-6987-4eeb-8b5f-3fac9cc36800 tempest-AttachVolumeNegativeTest-757293942 None] Deleting attachment 3c72e2eb-b7ae-4e73-a020-864243e9620e. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:49:10 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47eb86ff-2411-4402-b016-f0a076c43c25" returned: 0 in 0.717s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-quobyte-47eb86ff-2411-4402-b016-f0a076c43c25" released by "delete_volume" :: held 1.635s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Created reservations ['79fc6f4c-4720-4599-9938-9baed84d1e66', 'c2960969-583e-4e06-ac4e-fa49875ae9e4', '94ad7bb4-ac86-40d3-9d0f-53db2a8e4e7b', '10211a38-1e3a-42dd-b5af-0e0055cd4ee8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:10 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:10 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:10 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1" returned: 0 in 0.719s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92347c06-55ac-4b06-b3c3-76934abf120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5b5b64-d587-45cb-907f-580887a148d1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cce7e70-ee55-4a8d-8de9-4cbfbc68e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Volume volume-3c5b5b64-d587-45cb-907f-580887a148d1 (3c5b5b64-d587-45cb-907f-580887a148d1): created successfully Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cce7e70-ee55-4a8d-8de9-4cbfbc68e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (9bccf5b4-2e12-42ad-87d2-369e6accb320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:10 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-812653d5-d99b-418e-b36e-8598201a27e4 tempest-VolumesActionsTest-1448669804 None] Created volume successfully. Jul 01 06:49:11 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.663s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:11 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:11 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Deleted volume successfully. Jul 01 06:49:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ccbe238a-5f66-47da-8baa-06460e42619a tempest-VolumesListAdminTestJSON-142074666 None] Lock "cinder-47eb86ff-2411-4402-b016-f0a076c43c25-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-3c5b5b64-d587-45cb-907f-580887a148d1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Lock "cinder-3c5b5b64-d587-45cb-907f-580887a148d1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=100,cinder:UPDATE=132,cinder:INSERT=24,cinder:DELETE=10 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=108,cinder:SELECT=93,cinder:INSERT=26,cinder:DELETE=11 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Acquiring lock "cinder-quobyte-3c5b5b64-d587-45cb-907f-580887a148d1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-3c5b5b64-d587-45cb-907f-580887a148d1" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907071b-72d2-465f-9064-4f7870b0eb8a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:12 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 Jul 01 06:49:12 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:13 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:13 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1 Jul 01 06:49:13 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:14 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3c5b5b64-d587-45cb-907f-580887a148d1" returned: 0 in 0.935s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Lock "cinder-quobyte-3c5b5b64-d587-45cb-907f-580887a148d1" released by "delete_volume" :: held 1.870s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Created reservations ['db9d6665-bf71-4561-8a8a-631fb4348285', 'b8abd38b-56b2-47fe-8b02-5016198b3428', 'd6426f53-4405-4f30-a8e1-476e38a4563a', 'f45705af-482d-4693-a90a-e16011db8fdc'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:14 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:14 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:15 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.918s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (8bc95c6b-a00b-4604-b1af-011cf82c7fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa33c98-1f59-45c4-8da5-4a955bb7812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Deleted volume successfully. Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa33c98-1f59-45c4-8da5-4a955bb7812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-186632244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2101e787-b88f-413e-ab31-39d7f8e41c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:15Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f81979-7d27-47c2-9696-64834cbe5bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f81979-7d27-47c2-9696-64834cbe5bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72928a69-3146-4607-a891-7a3eaec0cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72928a69-3146-4607-a891-7a3eaec0cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2101e787-b88f-413e-ab31-39d7f8e41c75', 'volume_name': 'volume-2101e787-b88f-413e-ab31-39d7f8e41c75', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26c605c-3f37-4972-91b0-f9205ab3cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26c605c-3f37-4972-91b0-f9205ab3cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebd4039-6c32-47e2-a5a4-5001ca463c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:15 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Volume 2101e787-b88f-413e-ab31-39d7f8e41c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2101e787-b88f-413e-ab31-39d7f8e41c75', 'volume_size': 1} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-186632244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2101e787-b88f-413e-ab31-39d7f8e41c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d5a937a97b4b379f8ca41d49f00537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:15Z,use_quota=True,user_id='919202e5073c48b187a87712d92c6ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Creating volume 2101e787-b88f-413e-ab31-39d7f8e41c75 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:15 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-cd247990-ea9f-44f7-a550-84c17e76a6fb tempest-VolumesActionsTest-149576603 None] Lock "cinder-3c5b5b64-d587-45cb-907f-580887a148d1-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:15 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 1073741824 Jul 01 06:49:15 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:16 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 1073741824" returned: 0 in 1.048s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:16 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 Jul 01 06:49:16 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:17 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75" returned: 0 in 0.762s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebd4039-6c32-47e2-a5a4-5001ca463c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2101e787-b88f-413e-ab31-39d7f8e41c75', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368a0338-cb8f-4e7f-bb91-f12beebd286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Volume volume-2101e787-b88f-413e-ab31-39d7f8e41c75 (2101e787-b88f-413e-ab31-39d7f8e41c75): created successfully Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368a0338-cb8f-4e7f-bb91-f12beebd286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Flow 'volume_create_manager' (8bc95c6b-a00b-4604-b1af-011cf82c7fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e6619963-1ef0-426c-adf0-91e5b1814cb7 tempest-VolumesActionsTest-1448669804 None] Created volume successfully. Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Flow 'volume_create_manager' (6abac6b0-1f99-450e-b9e6-4d124cfa6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389af241-9aec-471e-bf4e-44647857371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389af241-9aec-471e-bf4e-44647857371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1694460956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ab7983-397a-497c-822a-c3804cabb1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ca0b48bbfb414fba14e0e825547d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:18Z,use_quota=True,user_id='39184183017a4d99a139b23bb7b8d939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685ba00b-9828-4edd-a30d-14e562907a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685ba00b-9828-4edd-a30d-14e562907a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b0d62e-b81f-49cf-b5bb-bef8a57b543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b0d62e-b81f-49cf-b5bb-bef8a57b543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ab7983-397a-497c-822a-c3804cabb1b1', 'volume_name': 'volume-27ab7983-397a-497c-822a-c3804cabb1b1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b3e9f-2ee9-4d40-b864-19ef831337bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b3e9f-2ee9-4d40-b864-19ef831337bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2385fc-1307-4c5a-9f72-0ed86cbcec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:18 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Volume 27ab7983-397a-497c-822a-c3804cabb1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ab7983-397a-497c-822a-c3804cabb1b1', 'volume_size': 1} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1694460956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ab7983-397a-497c-822a-c3804cabb1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ca0b48bbfb414fba14e0e825547d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:18Z,use_quota=True,user_id='39184183017a4d99a139b23bb7b8d939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Creating volume 27ab7983-397a-497c-822a-c3804cabb1b1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:18 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:18 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 1073741824 Jul 01 06:49:18 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "cinder-2101e787-b88f-413e-ab31-39d7f8e41c75-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-2101e787-b88f-413e-ab31-39d7f8e41c75-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "cinder-quobyte-2101e787-b88f-413e-ab31-39d7f8e41c75" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-quobyte-2101e787-b88f-413e-ab31-39d7f8e41c75" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20c3035-c80a-403d-9461-3d4f5c211b65]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:19 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 Jul 01 06:49:19 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:19 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 1073741824" returned: 0 in 0.994s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:19 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 Jul 01 06:49:19 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:20 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75" returned: 0 in 0.812s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:20 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75 Jul 01 06:49:20 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:20 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1" returned: 0 in 0.682s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2385fc-1307-4c5a-9f72-0ed86cbcec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ab7983-397a-497c-822a-c3804cabb1b1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b0f390-bb7c-405a-a1df-42e9993efd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:20 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Volume volume-27ab7983-397a-497c-822a-c3804cabb1b1 (27ab7983-397a-497c-822a-c3804cabb1b1): created successfully Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b0f390-bb7c-405a-a1df-42e9993efd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Flow 'volume_create_manager' (6abac6b0-1f99-450e-b9e6-4d124cfa6b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-790f9b52-4cc0-46a8-a804-da1fe13ddd16 tempest-VolumesTransfersTest-1015589810 None] Created volume successfully. Jul 01 06:49:20 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2101e787-b88f-413e-ab31-39d7f8e41c75" returned: 0 in 0.733s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-quobyte-2101e787-b88f-413e-ab31-39d7f8e41c75" released by "delete_volume" :: held 1.613s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Created reservations ['e63b22bc-d9b2-4116-bc5a-c20173cf13a8', '8650f5e8-66de-4c03-aca0-2fcd9265f7db', '6354de8b-6ae3-4ec1-b61c-32a57d2d6c22', 'edafa26a-b9ba-48bf-b85f-13fa5633f798'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:20 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:20 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5b8aa729-7aa2-4525-99c1-05f868bacabd tempest-VolumesTransfersTest-332675253 None] Transfer volume completed successfully. Jul 01 06:49:21 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.824s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:21 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Deleted volume successfully. Jul 01 06:49:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-acf93f4f-4db2-4d39-ba6a-cfe228b84336 tempest-VolumesActionsTest-1448669804 None] Lock "cinder-2101e787-b88f-413e-ab31-39d7f8e41c75-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Acquiring lock "cinder-27ab7983-397a-497c-822a-c3804cabb1b1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-27ab7983-397a-497c-822a-c3804cabb1b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Acquiring lock "cinder-quobyte-27ab7983-397a-497c-822a-c3804cabb1b1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-quobyte-27ab7983-397a-497c-822a-c3804cabb1b1" acquired by "delete_volume" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:22 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4af65-f271-4a2d-8013-9f3cf9b25afd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:22 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 Jul 01 06:49:22 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:24 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1" returned: 0 in 1.385s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:24 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1 Jul 01 06:49:24 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:25 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-27ab7983-397a-497c-822a-c3804cabb1b1" returned: 0 in 1.095s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-quobyte-27ab7983-397a-497c-822a-c3804cabb1b1" released by "delete_volume" :: held 2.541s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Created reservations ['9c346884-1810-4c53-b516-d1ae5e4b54e0', 'c5f784ff-cb5f-442d-8959-bcf335e46cfe', '6217ec31-f67b-4b47-9a2a-15487ceaf966', 'c10dcec3-22af-4266-b74b-18159947a63b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:25 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:25 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:26 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:26 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:26 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.256s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Deleted volume successfully. Jul 01 06:49:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-64407b41-db20-4a9e-9342-931439a1c4cd tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-27ab7983-397a-497c-822a-c3804cabb1b1-delete_volume" released by "delete_volume" :: held 4.215s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Flow 'volume_create_manager' (7b0480e2-9e20-4709-85bf-eefd34adc571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b9a842-4a4a-4021-a372-34b6afe30a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b9a842-4a4a-4021-a372-34b6afe30a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1666371188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c65f518-60f8-42a0-8994-8337f6ded17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ca0b48bbfb414fba14e0e825547d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:27Z,use_quota=True,user_id='39184183017a4d99a139b23bb7b8d939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a35651-d186-4947-aa02-27659f83651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a35651-d186-4947-aa02-27659f83651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b670b4-33df-44eb-8499-da07411d8d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b670b4-33df-44eb-8499-da07411d8d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c65f518-60f8-42a0-8994-8337f6ded17a', 'volume_name': 'volume-1c65f518-60f8-42a0-8994-8337f6ded17a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e127cf2c-592a-4d01-bdef-7725aa9e5bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e127cf2c-592a-4d01-bdef-7725aa9e5bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3b4f0b-5ce1-4d97-a897-3b86934ffb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:27 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Volume 1c65f518-60f8-42a0-8994-8337f6ded17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c65f518-60f8-42a0-8994-8337f6ded17a', 'volume_size': 1} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1666371188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c65f518-60f8-42a0-8994-8337f6ded17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ca0b48bbfb414fba14e0e825547d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:27Z,use_quota=True,user_id='39184183017a4d99a139b23bb7b8d939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Creating volume 1c65f518-60f8-42a0-8994-8337f6ded17a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:27 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:27 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a 1073741824 Jul 01 06:49:27 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:27 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.330s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 8 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:49:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:49:28 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a 1073741824" returned: 0 in 1.298s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:28 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a Jul 01 06:49:28 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:29 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3b4f0b-5ce1-4d97-a897-3b86934ffb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c65f518-60f8-42a0-8994-8337f6ded17a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52d3ac8-29fa-4877-8f3a-9cad3e236ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:29 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Volume volume-1c65f518-60f8-42a0-8994-8337f6ded17a (1c65f518-60f8-42a0-8994-8337f6ded17a): created successfully Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52d3ac8-29fa-4877-8f3a-9cad3e236ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Flow 'volume_create_manager' (7b0480e2-9e20-4709-85bf-eefd34adc571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a3307060-f90e-44e6-9c47-827c2875d6da tempest-VolumesTransfersTest-1015589810 None] Created volume successfully. Jul 01 06:49:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Acquiring lock "cinder-1c65f518-60f8-42a0-8994-8337f6ded17a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-1c65f518-60f8-42a0-8994-8337f6ded17a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Acquiring lock "cinder-quobyte-1c65f518-60f8-42a0-8994-8337f6ded17a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-quobyte-1c65f518-60f8-42a0-8994-8337f6ded17a" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:31 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86d0133-6509-4f5a-9c00-bed6077fe36c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:31 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a Jul 01 06:49:31 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:32 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a" returned: 0 in 1.123s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:32 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a Jul 01 06:49:32 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:33 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c65f518-60f8-42a0-8994-8337f6ded17a" returned: 0 in 1.812s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-quobyte-1c65f518-60f8-42a0-8994-8337f6ded17a" released by "delete_volume" :: held 3.017s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Created reservations ['29f555fa-16c0-407b-bcb4-5c010b911dc7', '7c23c51e-e268-4244-9d80-1ba7fb6d13e8', '558a9722-f81f-4800-8bc4-fde9b90b0164', 'c6033d1b-e1b7-4ecc-8521-3a46fbbc136c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:34 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:34 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:35 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.482s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:35 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Deleted volume successfully. Jul 01 06:49:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5aa8ea62-db2e-4069-9e4a-b93d299a461f tempest-VolumesTransfersTest-1348017410 None] Lock "cinder-1c65f518-60f8-42a0-8994-8337f6ded17a-delete_volume" released by "delete_volume" :: held 4.891s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Flow 'volume_create_manager' (6d38cc0e-4c11-49c8-8d99-8470efc515ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489cbf1d-47b2-499b-bdec-755375f9cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489cbf1d-47b2-499b-bdec-755375f9cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1590113104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778bbe0252104dbda093fd1ac0546b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:40Z,use_quota=True,user_id='4bee8dc70101478894650d78dfeff693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c495c921-296a-44f3-ae10-f90acf4df89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c495c921-296a-44f3-ae10-f90acf4df89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac187fe6-506c-4b1f-94f6-38b948e0c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac187fe6-506c-4b1f-94f6-38b948e0c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba', 'volume_name': 'volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3134f8c-a088-4ff3-ba47-4989e4ae3ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3134f8c-a088-4ff3-ba47-4989e4ae3ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e0bc6c-54c7-44b5-a21f-f125bf50f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:39 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Volume 7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba', 'volume_size': 1} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1590113104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778bbe0252104dbda093fd1ac0546b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:40Z,use_quota=True,user_id='4bee8dc70101478894650d78dfeff693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Creating volume 7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:39 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:39 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba 1073741824 Jul 01 06:49:39 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:40 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba 1073741824" returned: 0 in 1.013s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:40 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba Jul 01 06:49:40 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:41 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba" returned: 0 in 0.705s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e0bc6c-54c7-44b5-a21f-f125bf50f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2146a3e9-9a50-461c-8c66-e409e79215e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:41 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Volume volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba (7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba): created successfully Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2146a3e9-9a50-461c-8c66-e409e79215e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Flow 'volume_create_manager' (6d38cc0e-4c11-49c8-8d99-8470efc515ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:41 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-351f06eb-a002-4f96-addc-4b82aca9d1f4 tempest-AbsoluteLimitsTests-2141316369 None] Created volume successfully. Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (2360d66d-c0fb-4e24-858f-067f2ef5693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c9e568-a05c-4f21-84e7-b1f35a38bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c9e568-a05c-4f21-84e7-b1f35a38bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342790863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e099e77-7db8-4fb8-bb1f-534f53d9faf5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:42Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c89f51-65e3-4e28-96f9-ed7e610d8a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c89f51-65e3-4e28-96f9-ed7e610d8a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40774f9-765e-4f11-ad41-c97634cdfcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40774f9-765e-4f11-ad41-c97634cdfcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e099e77-7db8-4fb8-bb1f-534f53d9faf5', 'volume_name': 'volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fe3cd4-0928-4ad3-bc1b-1ef1d79ee9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fe3cd4-0928-4ad3-bc1b-1ef1d79ee9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa3cc2a-1324-4a18-9139-22c6ef94074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:42 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Volume 7e099e77-7db8-4fb8-bb1f-534f53d9faf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5', 'volume_size': 1} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342790863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e099e77-7db8-4fb8-bb1f-534f53d9faf5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:42Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Creating volume 7e099e77-7db8-4fb8-bb1f-534f53d9faf5 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:42 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:42 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 1073741824 Jul 01 06:49:42 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Acquiring lock "cinder-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Lock "cinder-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Acquiring lock "cinder-quobyte-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Lock "cinder-quobyte-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba" acquired by "delete_volume" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78a6a3a-2836-4a10-a13d-aaa1b916fd57]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:42 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba Jul 01 06:49:42 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:43 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 1073741824" returned: 0 in 1.345s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:43 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 Jul 01 06:49:43 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:43 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba" returned: 0 in 1.180s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:43 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba Jul 01 06:49:43 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:44 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5" returned: 0 in 1.099s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] <== create_volume: return (2485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa3cc2a-1324-4a18-9139-22c6ef94074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a861cd9-b5e4-43e8-9b69-198c27acf142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:44 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Volume volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 (7e099e77-7db8-4fb8-bb1f-534f53d9faf5): created successfully Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a861cd9-b5e4-43e8-9b69-198c27acf142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (2360d66d-c0fb-4e24-858f-067f2ef5693b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba" returned: 0 in 1.105s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Lock "cinder-quobyte-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba" released by "delete_volume" :: held 2.373s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b7d2ab17-8af8-4455-828e-fe0356b8d0b6 tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Created reservations ['aad25b07-5a4d-46f2-bb4d-cec37d67cb3f', '94a835e8-57bb-4615-8cbf-316a13577eac', '9517c244-4804-46cd-9c91-7e2dcf76f91f', '3e51b94e-9790-4ceb-a2f0-b5bd05a34309'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:44 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:44 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:45 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.907s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:45 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Deleted volume successfully. Jul 01 06:49:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c25ccf74-c3ac-46f1-9d97-657f0e8a72fc tempest-AbsoluteLimitsTests-2141316369 None] Lock "cinder-7b4be78c-4d6b-4ec2-99b0-b16a34c4ebba-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (6e9c394c-2f5b-428f-bcee-e87138545bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e19da7-721f-4c5d-a769-b12d2bf99149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e19da7-721f-4c5d-a769-b12d2bf99149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1516137011',display_name='tempest-VolumesGetTest-Volume-2020057376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e233da-9570-47a3-b887-7d3855ed1ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:46Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c560eba-b8cf-4a72-90b8-2ba2abe04a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c560eba-b8cf-4a72-90b8-2ba2abe04a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c601332-3c3c-4bbd-abfc-01e1fc6f09fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c601332-3c3c-4bbd-abfc-01e1fc6f09fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e233da-9570-47a3-b887-7d3855ed1ca1', 'volume_name': 'volume-f6e233da-9570-47a3-b887-7d3855ed1ca1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e30007-7f0b-4840-8755-62a06a24e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e30007-7f0b-4840-8755-62a06a24e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072496b1-199f-46a3-b251-18312da8b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Volume f6e233da-9570-47a3-b887-7d3855ed1ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e233da-9570-47a3-b887-7d3855ed1ca1', 'volume_size': 1} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1516137011',display_name='tempest-VolumesGetTest-Volume-2020057376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e233da-9570-47a3-b887-7d3855ed1ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:46Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Creating volume f6e233da-9570-47a3-b887-7d3855ed1ca1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:46 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:46 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 1073741824 Jul 01 06:49:46 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:47 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 1073741824" returned: 0 in 1.159s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:47 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 Jul 01 06:49:47 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:48 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1" returned: 0 in 1.078s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072496b1-199f-46a3-b251-18312da8b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e233da-9570-47a3-b887-7d3855ed1ca1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0977c3bb-ba8d-4ebc-8431-774dd58f0c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Volume volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 (f6e233da-9570-47a3-b887-7d3855ed1ca1): created successfully Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0977c3bb-ba8d-4ebc-8431-774dd58f0c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (6e9c394c-2f5b-428f-bcee-e87138545bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1d962942-3bd1-4c23-86b4-e97db9116bed tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-f6e233da-9570-47a3-b887-7d3855ed1ca1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Lock "cinder-f6e233da-9570-47a3-b887-7d3855ed1ca1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-f6e233da-9570-47a3-b887-7d3855ed1ca1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-f6e233da-9570-47a3-b887-7d3855ed1ca1" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf2e00-b620-493a-a558-c2027d8b9317]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:49 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 Jul 01 06:49:49 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-dffb0347-bb18-47a1-a94f-4890cb9c6d3e req-56f3eb17-caea-4867-84c7-7003484a9e04 tempest-AttachVolumeTestJSON-1369393165 None] Terminate volume connection completed successfully. Jul 01 06:49:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-dffb0347-bb18-47a1-a94f-4890cb9c6d3e req-56f3eb17-caea-4867-84c7-7003484a9e04 tempest-AttachVolumeTestJSON-1369393165 None] Deleting attachment 50220575-1b49-4a0e-bc48-8e9462b9ea60. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:49:50 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1" returned: 0 in 0.897s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:50 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1 Jul 01 06:49:50 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Flow 'volume_create_manager' (5e3798d2-0a45-4e7c-803e-902c34b45163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba70b6e5-149d-48bd-ac61-812b0386a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba70b6e5-149d-48bd-ac61-812b0386a42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-214576291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e89a382fcf447f7bb1812d626bb387f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:51Z,use_quota=True,user_id='c604f37ea8ec4620a3178ccc944f3a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f1f793-9fe8-49de-a08a-dfc9fe6b8459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f1f793-9fe8-49de-a08a-dfc9fe6b8459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe54de1-a634-4e10-9325-a19fcfc67fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe54de1-a634-4e10-9325-a19fcfc67fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e7c1f9-13ae-4a0e-8ffd-4493a8d73418', 'volume_name': 'volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f593b0c3-edd9-4cf6-91bc-d2d590e7032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f593b0c3-edd9-4cf6-91bc-d2d590e7032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da7705b-fb02-46ff-875a-a2795e316254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Volume d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418', 'volume_size': 1} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-214576291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e89a382fcf447f7bb1812d626bb387f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:51Z,use_quota=True,user_id='c604f37ea8ec4620a3178ccc944f3a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Creating volume d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:51 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:51 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 1073741824 Jul 01 06:49:51 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:51 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f6e233da-9570-47a3-b887-7d3855ed1ca1" returned: 0 in 0.939s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-f6e233da-9570-47a3-b887-7d3855ed1ca1" released by "delete_volume" :: held 1.909s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Created reservations ['0be391e6-6d20-4663-b57c-6b9ccb714eab', '1c8ab70a-7d08-4b32-91eb-897d9fdfd907', 'fefb4112-ef2f-47df-9006-ff6deabacf39', '72ae5e0b-0121-487c-84b6-bcc672b309f9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:51 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:51 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-7e099e77-7db8-4fb8-bb1f-534f53d9faf5-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Lock "cinder-7e099e77-7db8-4fb8-bb1f-534f53d9faf5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-7e099e77-7db8-4fb8-bb1f-534f53d9faf5" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-7e099e77-7db8-4fb8-bb1f-534f53d9faf5" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f01b99f-5f57-499b-accb-f773b832f297]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:52 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 Jul 01 06:49:52 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:52 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.991s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-52254791-4d2b-4239-8cb8-17ae49ee0e85 tempest-VolumesGetTest-1455123675 None] Lock "cinder-f6e233da-9570-47a3-b887-7d3855ed1ca1-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:52 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 1073741824" returned: 0 in 1.451s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:53 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 Jul 01 06:49:53 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:53 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5" returned: 0 in 1.427s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:53 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5 Jul 01 06:49:53 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:53 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418" returned: 0 in 0.881s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da7705b-fb02-46ff-875a-a2795e316254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426b2467-c52a-400a-b1c2-af998f37e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Volume volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 (d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418): created successfully Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426b2467-c52a-400a-b1c2-af998f37e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Flow 'volume_create_manager' (5e3798d2-0a45-4e7c-803e-902c34b45163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1977f915-319f-49da-adb8-3f6e917f0040 tempest-VolumesMetadataTest-507867304 None] Created volume successfully. Jul 01 06:49:54 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e099e77-7db8-4fb8-bb1f-534f53d9faf5" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-7e099e77-7db8-4fb8-bb1f-534f53d9faf5" released by "delete_volume" :: held 2.297s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Created reservations ['f7386c53-beea-44a9-8d50-948457f793e2', '5b314a14-6a54-4714-bd76-d9ba24569980', '63cef2a0-03e8-4d47-a95b-79f15c21f89a', '9a8966eb-de8a-41d7-acc8-ba6160126a9a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:54 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:54 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:55 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e56457a2-3f2e-4e2f-b0b0-deb897bb8005 tempest-VolumesGetTest-1455123675 None] Lock "cinder-7e099e77-7db8-4fb8-bb1f-534f53d9faf5-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Acquiring lock "cinder-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Lock "cinder-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Acquiring lock "cinder-quobyte-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Lock "cinder-quobyte-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418" acquired by "delete_volume" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c323d-5ff5-4127-96a5-8fdee12eb124]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:55 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 Jul 01 06:49:55 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (831d5945-e0c1-4d40-ace2-83e0db4b592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a94bf8-2169-42bb-b25a-ea536934da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a94bf8-2169-42bb-b25a-ea536934da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1259554445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3be8f8f-1bf6-4813-b6d3-98c9c4895573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:56Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632face8-a1cf-4a0b-afc0-0aacd87d0c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632face8-a1cf-4a0b-afc0-0aacd87d0c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbeabb59-efba-4af9-8b92-aa12844c5438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbeabb59-efba-4af9-8b92-aa12844c5438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'volume_name': 'volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cbe7e1-f3a9-4fd7-a859-1dec07ccafef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cbe7e1-f3a9-4fd7-a859-1dec07ccafef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953f473d-24e7-441e-a63b-e924aac12cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Volume f3be8f8f-1bf6-4813-b6d3-98c9c4895573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'volume_size': 1} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1259554445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3be8f8f-1bf6-4813-b6d3-98c9c4895573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:56Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Creating volume f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:49:56 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:56 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 1073741824 Jul 01 06:49:56 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:56 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418" returned: 0 in 0.834s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:56 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418 Jul 01 06:49:56 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:57 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 1073741824" returned: 0 in 0.878s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:57 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:49:57 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:57 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418" returned: 0 in 0.636s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Lock "cinder-quobyte-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418" released by "delete_volume" :: held 1.543s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Created reservations ['73278288-1dcf-406f-841b-a2ebf6e6ca60', '28ce515a-eda0-4a52-8961-cae6e6631538', 'ece25111-da56-4185-b3cc-48f2a3ec3cf6', '5b30aa26-d6cc-4ac5-8260-9b7f2ef53771'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:57 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:49:57 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:57 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 0.659s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953f473d-24e7-441e-a63b-e924aac12cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4198b6a0-23a6-4f44-8889-3e0d1a97f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Volume volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 (f3be8f8f-1bf6-4813-b6d3-98c9c4895573): created successfully Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4198b6a0-23a6-4f44-8889-3e0d1a97f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (831d5945-e0c1-4d40-ace2-83e0db4b592b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7db69a88-4b2a-4806-ac8b-f7e136940e4b tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:49:58 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.668s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:49:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Deleted volume successfully. Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-810cd148-3585-4b4c-9a01-2810bffe998b tempest-VolumesMetadataTest-507867304 None] Lock "cinder-d2e7c1f9-13ae-4a0e-8ffd-4493a8d73418-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (aab96422-af9d-408c-a97f-718993440ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b642ac57-bea9-4064-9644-795a3103ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b642ac57-bea9-4064-9644-795a3103ff90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-369315565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11e8cbf-78b9-4fba-8108-6d8f86085f6b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f3be8f8f-1bf6-4813-b6d3-98c9c4895573,status='creating',terminated_at=None,updated_at=2026-07-01T04:49:59Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d1f468-e85e-41cb-aed8-9f79971bd7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d1f468-e85e-41cb-aed8-9f79971bd7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275b43af-0b97-4d1c-a75b-1cbaac89d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275b43af-0b97-4d1c-a75b-1cbaac89d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd11e8cbf-78b9-4fba-8108-6d8f86085f6b', 'volume_name': 'volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b', 'volume_size': 1, 'source_volid': 'f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'source_volstatus': 'available'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a359fe-f908-4f92-bcdf-51c0abd436f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a359fe-f908-4f92-bcdf-51c0abd436f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599d3e30-baec-42d4-9888-581989c21f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:49:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Volume d11e8cbf-78b9-4fba-8108-6d8f86085f6b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b', 'volume_size': 1, 'source_volid': 'f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'source_volstatus': 'available'} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:49:58 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Cloning volume f3be8f8f-1bf6-4813-b6d3-98c9c4895573 to volume d11e8cbf-78b9-4fba-8108-6d8f86085f6b Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Creating offline snapshot 03d0049d-2b0b-4b3f-8646-61ab70aa748a of volume f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f8445f-3d45-4190-91f3-3e8c44246350]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:49:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:58 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:49:58 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:49:59 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 01 06:49:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 0.810s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:49:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:49:59 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a 1G Jul 01 06:49:59 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:00 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a 1G" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:00 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a Jul 01 06:50:00 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:01 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a" returned: 0 in 0.766s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:01 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a is being set with open permissions: ugo+rw Jul 01 06:50:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:01 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a Jul 01 06:50:01 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:02 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a" returned: 0 in 0.713s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:02 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info Jul 01 06:50:02 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:02 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info" returned: 0 in 0.917s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:02 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info is being set with open permissions: ugo+rw Jul 01 06:50:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:03 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info Jul 01 06:50:03 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:04 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.info" returned: 0 in 1.119s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] snapshot: 03d0049d-2b0b-4b3f-8646-61ab70aa748a, volume: d11e8cbf-78b9-4fba-8108-6d8f86085f6b, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2203c2-5bd1-44f0-b871-ba699ad9ac75]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:04 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a Jul 01 06:50:04 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:05 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a" returned: 0 in 1.274s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:50:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:50:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:50:05 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ebdb7-c77f-4d55-b2b4-5e43feca6fff]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:05 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:50:05 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 1.062s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:06 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:06 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:50:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:06 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b Jul 01 06:50:06 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:07 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Flow 'volume_create_manager' (46e208b0-9c5f-456b-9c62-7379bc598fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a3b70d-382b-4719-8f96-abab787dd409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a3b70d-382b-4719-8f96-abab787dd409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-264646235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cee47b791d4be081e92dfca7bd4ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:08Z,use_quota=True,user_id='a956a081a55944d69781d3aa3038994c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f132fec1-016a-4276-97c2-eefebdd658c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f132fec1-016a-4276-97c2-eefebdd658c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf3fb93-0c4e-4df4-b42c-1e951014e416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf3fb93-0c4e-4df4-b42c-1e951014e416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050', 'volume_name': 'volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0edd677-ee56-4483-b88f-4d4b3b3a0a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0edd677-ee56-4483-b88f-4d4b3b3a0a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefabedc-15b1-4ef8-9ffc-41e9c8048437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:08 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Volume 6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050', 'volume_size': 1} Jul 01 06:50:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:14 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" returned: 0 in 8.206s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab225e0-9865-4a23-a68a-07c8986e9f22]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:14 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:50:14 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:15 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 1.007s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:15 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:50:15 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Converted 1024.00 MB image at 124.77 MB/s Jul 01 06:50:15 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b is being set with open permissions: ugo+rw Jul 01 06:50:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:15 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b Jul 01 06:50:15 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:16 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" returned: 0 in 0.906s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" released by "_copy_volume_from_snapshot" :: held 12.604s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=66,cinder:INSERT=19,cinder:UPDATE=84,cinder:DELETE=8 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-03d0049d-2b0b-4b3f-8646-61ab70aa748a" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-03d0049d-2b0b-4b3f-8646-61ab70aa748a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Deleting offline snapshot 03d0049d-2b0b-4b3f-8646-61ab70aa748a of volume f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] snapshot_file for this snap is: volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb1be50-aefd-4c9a-9102-335016b8aef5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:17 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a Jul 01 06:50:17 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=59,cinder:INSERT=23,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (bc095657-b5c8-4fcf-8599-1d2ae8324059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9943cb41-5ca0-4b70-b5b6-4cd0b14487df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9943cb41-5ca0-4b70-b5b6-4cd0b14487df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29813284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02411e9a-3cae-4f48-b521-5e6ab362561d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:17Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d484e1-5c18-47e8-a8f1-0d14569b963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d484e1-5c18-47e8-a8f1-0d14569b963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf1ce29-1220-4b1d-b977-14c2f5335c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf1ce29-1220-4b1d-b977-14c2f5335c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02411e9a-3cae-4f48-b521-5e6ab362561d', 'volume_name': 'volume-02411e9a-3cae-4f48-b521-5e6ab362561d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eb89a9-6507-4fe2-b63c-5c618c0cd177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eb89a9-6507-4fe2-b63c-5c618c0cd177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c852ba69-59c1-434a-a6fa-07fc28c7102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Volume 02411e9a-3cae-4f48-b521-5e6ab362561d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02411e9a-3cae-4f48-b521-5e6ab362561d', 'volume_size': 1} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:17 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a" returned: 0 in 0.808s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd60736-9924-4155-ab6f-d27db86c7a67]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:17 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:50:17 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:18 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 0.737s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:18 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a Jul 01 06:50:18 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:19 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a" returned: 0 in 0.722s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:19 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a Jul 01 06:50:19 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:19 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573.03d0049d-2b0b-4b3f-8646-61ab70aa748a" returned: 0 in 0.641s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-03d0049d-2b0b-4b3f-8646-61ab70aa748a" released by "_delete_snapshot" :: held 3.026s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.081s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.789s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-264646235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4cee47b791d4be081e92dfca7bd4ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:08Z,use_quota=True,user_id='a956a081a55944d69781d3aa3038994c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Creating volume 6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:19 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599d3e30-baec-42d4-9888-581989c21f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b', 'volume_size': 1, 'source_volid': 'f3be8f8f-1bf6-4813-b6d3-98c9c4895573', 'source_volstatus': 'available'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:19 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 1073741824 Jul 01 06:50:19 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc21bcbe-f3fd-458c-9330-d804795a52f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Volume volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b (d11e8cbf-78b9-4fba-8108-6d8f86085f6b): created successfully Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc21bcbe-f3fd-458c-9330-d804795a52f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (aab96422-af9d-408c-a97f-718993440ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c203354e-7315-434f-8cb7-1e5f7d91d790 tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:50:20 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 1073741824" returned: 0 in 0.841s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:20 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 Jul 01 06:50:20 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:20 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (a4d74cc8-8d21-4fb9-b481-7363568936f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a8ee51-31b6-4c88-81ca-8f6f174f6215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a8ee51-31b6-4c88-81ca-8f6f174f6215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1450825446',display_name='tempest-VolumesGetTest-Volume-1875985778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d4ccd4-3bfb-4c18-92b6-1996e936e1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:21Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac5b47a-2d0a-4d73-a37f-a641f064416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac5b47a-2d0a-4d73-a37f-a641f064416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c2744a-55a5-4343-8540-88df396ca90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c2744a-55a5-4343-8540-88df396ca90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d4ccd4-3bfb-4c18-92b6-1996e936e1c9', 'volume_name': 'volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5edc76d-1c34-4229-a43b-bb90838b1523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5edc76d-1c34-4229-a43b-bb90838b1523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e67c90-a1c2-446c-84cb-254070091d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Volume 18d4ccd4-3bfb-4c18-92b6-1996e936e1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9', 'volume_size': 1} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:21 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" returned: 0 in 0.681s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.237s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29813284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02411e9a-3cae-4f48-b521-5e6ab362561d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:17Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Creating volume 02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:21 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefabedc-15b1-4ef8-9ffc-41e9c8048437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:21 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d 1073741824 Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61305fb1-66a6-4899-9356-d2241d67b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:21 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Volume volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 (6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050): created successfully Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61305fb1-66a6-4899-9356-d2241d67b383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Flow 'volume_create_manager' (46e208b0-9c5f-456b-9c62-7379bc598fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9729d2f6-353c-4634-8dcc-22c269d892d7 tempest-AttachVolumeNegativeTest-757293942 None] Created volume successfully. Jul 01 06:50:22 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d 1073741824" returned: 0 in 0.807s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:22 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d Jul 01 06:50:22 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:23 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d" returned: 0 in 0.724s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1450825446',display_name='tempest-VolumesGetTest-Volume-1875985778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d4ccd4-3bfb-4c18-92b6-1996e936e1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:21Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Creating volume 18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:23 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:23 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 1073741824 Jul 01 06:50:23 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c852ba69-59c1-434a-a6fa-07fc28c7102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02411e9a-3cae-4f48-b521-5e6ab362561d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b695830-c92e-477c-8823-880e29c5107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:23 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Volume volume-02411e9a-3cae-4f48-b521-5e6ab362561d (02411e9a-3cae-4f48-b521-5e6ab362561d): created successfully Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b695830-c92e-477c-8823-880e29c5107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (bc095657-b5c8-4fcf-8599-1d2ae8324059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:23 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a0ffdbdf-0611-4b25-8db8-384bfe92b2db tempest-VolumesSnapshotTestJSON-577538962 None] Created volume successfully. Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:23 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 1073741824" returned: 0 in 0.853s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:23 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 Jul 01 06:50:23 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:24 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9" returned: 0 in 0.658s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.887s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e67c90-a1c2-446c-84cb-254070091d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c328e7-be95-49e1-a8c0-ba71dce5791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Creating offline snapshot 8ddc6061-2148-49b8-8198-310e5539032b of volume 02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:50:24 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Volume volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 (18d4ccd4-3bfb-4c18-92b6-1996e936e1c9): created successfully Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c328e7-be95-49e1-a8c0-ba71dce5791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (a4d74cc8-8d21-4fb9-b481-7363568936f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64bf103-ac34-4782-a4b7-d3cf0b3afbec]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:24 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-50efb1da-c468-4181-a185-42660b6745a4 tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:50:24 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d Jul 01 06:50:24 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Lock "cinder-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca192a47-24a3-4950-93d5-08fa7f14a619]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:25 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d" returned: 0 in 0.809s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:25 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 Jul 01 06:50:25 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:25 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b 1G Jul 01 06:50:25 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:26 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9" returned: 0 in 0.781s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:26 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9 Jul 01 06:50:26 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:26 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b 1G" returned: 0 in 0.803s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02411e9a-3cae-4f48-b521-5e6ab362561d -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:26 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02411e9a-3cae-4f48-b521-5e6ab362561d -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b Jul 01 06:50:26 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:26 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:26 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:26 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9" returned: 0 in 0.692s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9" released by "delete_volume" :: held 1.518s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Created reservations ['7b9674a7-fbcf-4354-9141-655a864ec019', '317b7331-5917-4aa5-9f5c-f2aeeff5c79f', '1d5268de-3707-42cd-8107-0e140e37a7b4', 'b1bdedee-4283-45be-8911-26bf39b4eaa2'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:26 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02411e9a-3cae-4f48-b521-5e6ab362561d -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b" returned: 0 in 0.734s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:27 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b is being set with open permissions: ugo+rw Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:27 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:27 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:27 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b Jul 01 06:50:27 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:27 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.705s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 8 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-d11e8cbf-78b9-4fba-8108-6d8f86085f6b-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:27 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Lock "cinder-d11e8cbf-78b9-4fba-8108-6d8f86085f6b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.710s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:50:27 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:50:27 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b" returned: 0 in 0.730s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8ccc682e-2894-4fe2-b6b2-31bca35856ff tempest-VolumesGetTest-1455123675 None] Lock "cinder-18d4ccd4-3bfb-4c18-92b6-1996e936e1c9-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c35ca9-c49f-4fbb-bfb0-605da46d9da4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:27 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info Jul 01 06:50:27 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:28 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b Jul 01 06:50:28 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:28 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info" returned: 0 in 0.689s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:28 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info is being set with open permissions: ugo+rw Jul 01 06:50:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:28 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info Jul 01 06:50:28 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:28 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" returned: 0 in 0.830s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:28 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b Jul 01 06:50:28 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:29 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.info" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:29 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.890s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.732s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" returned: 0 in 0.790s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c0fc1-7d64-4eaf-b371-857aa4c7ee29]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-d11e8cbf-78b9-4fba-8108-6d8f86085f6b" released by "delete_volume" :: held 1.697s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b760a70a-3de5-44c8-87fd-28a8e1ac270c tempest-VolumesSnapshotTestJSON-577538962 None] Create snapshot completed successfully Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Created reservations ['53e4ee00-82e7-4d12-b560-64b512983b2a', '3dbee3af-4f70-45ce-bf38-bedd86670d23', '9aba3743-aaca-478b-b4d2-0d79db36381c', '552e6fdc-6b82-455d-a9cc-098f05967948'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:29 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 Jul 01 06:50:29 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:29 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:29 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-f3be8f8f-1bf6-4813-b6d3-98c9c4895573-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Lock "cinder-f3be8f8f-1bf6-4813-b6d3-98c9c4895573-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b8afd-b70d-43db-96a1-18001b5c6571]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-8ddc6061-2148-49b8-8198-310e5539032b-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-8ddc6061-2148-49b8-8198-310e5539032b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:30 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:50:30 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-02411e9a-3cae-4f48-b521-5e6ab362561d" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-02411e9a-3cae-4f48-b521-5e6ab362561d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-8ddc6061-2148-49b8-8198-310e5539032b" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-8ddc6061-2148-49b8-8198-310e5539032b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Deleting offline snapshot 8ddc6061-2148-49b8-8198-310e5539032b of volume 02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] snapshot_file for this snap is: volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32404f-e0f6-44ba-b598-09977bcbffd3]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:30 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" returned: 0 in 1.105s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.137s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:30 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b Jul 01 06:50:30 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:30 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.933s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:50:30 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27d1c8a3-2a51-404e-abed-70f34dfe0d95', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:50:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dbfd2ee-86cc-499c-a386-ce4b77bbbe30 tempest-VolumesGetTest-1455123675 None] Lock "cinder-d11e8cbf-78b9-4fba-8108-6d8f86085f6b-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:30 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-d86f6150-93d2-42e9-905e-cc1bfb9bc32e req-73b8e725-62ab-433e-8f76-fe8be136341c tempest-AttachVolumeNegativeTest-757293942 None] attachment_update completed successfully. Jul 01 06:50:31 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 1.161s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:31 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573 Jul 01 06:50:31 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:31 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b" returned: 0 in 1.009s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02411e9a-3cae-4f48-b521-5e6ab362561d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:50:31 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc514a-2dee-4d9d-9553-fd2d168461fa]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:31 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d Jul 01 06:50:31 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:32 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" returned: 0 in 0.821s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-f3be8f8f-1bf6-4813-b6d3-98c9c4895573" released by "delete_volume" :: held 2.056s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Created reservations ['37db2018-1266-4df5-abd4-752807c25391', '1b33aff2-e116-42f5-aab2-0b2262a95a03', 'de95fdf2-eb66-494a-a6f4-dc0fb8165e25', '65cfc684-7792-4d64-a654-07ee748a0977'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:32 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:32 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:32 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d" returned: 0 in 1.013s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:32 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b Jul 01 06:50:32 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:33 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.725s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:50:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c6d338aa-4e24-4b10-b4c3-d902a76af810 tempest-VolumesGetTest-1455123675 None] Lock "cinder-f3be8f8f-1bf6-4813-b6d3-98c9c4895573-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:33 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b" returned: 0 in 0.913s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:33 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b Jul 01 06:50:33 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (0f8e7e68-9348-4571-a9f8-ba863eb6763d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a951ffee-e32d-4bdf-94b1-a6e7b369eb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a951ffee-e32d-4bdf-94b1-a6e7b369eb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-957105756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2447d34-09dd-48ae-b7c9-5e68c21b2352,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:34Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8265dec9-2df6-4d9d-87e0-e8130df49a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8265dec9-2df6-4d9d-87e0-e8130df49a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f228949b-7497-4e3e-bcb2-db1b635aa92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:33 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f228949b-7497-4e3e-bcb2-db1b635aa92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2447d34-09dd-48ae-b7c9-5e68c21b2352', 'volume_name': 'volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb36142d-2d77-4448-be0a-0adb062a7c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb36142d-2d77-4448-be0a-0adb062a7c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb9b6b3-91d8-404f-a34e-7b45d84efbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:34 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Volume d2447d34-09dd-48ae-b7c9-5e68c21b2352: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Trying to clone d2447d34-09dd-48ae-b7c9-5e68c21b2352 from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 06:50:34 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d.8ddc6061-2148-49b8-8198-310e5539032b" returned: 0 in 0.679s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-8ddc6061-2148-49b8-8198-310e5539032b" released by "_delete_snapshot" :: held 3.807s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-02411e9a-3cae-4f48-b521-5e6ab362561d" released by "delete_snapshot" :: held 3.837s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['1a428ee0-3d3f-4402-8e5c-9c61f31999f9', '70ab6f18-4020-4f32-96f3-eb2af82509ea', '5224f2e4-ea9a-4b11-8c8b-bffcb40ab397', '4c0c88df-6724-411e-bbc3-e0e6c12dfb68'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 06:50:34 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Image download 20.69 MB at 20.69 MB/s Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f831e95b-ac26-4799-b7eb-577d7481a1ec]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Delete snapshot completed successfully. Jul 01 06:50:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bd36734b-1c9b-430c-9a7b-94c4ca806b96 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-8ddc6061-2148-49b8-8198-310e5539032b-delete_snapshot" released by "delete_snapshot" :: held 4.198s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:34 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD Jul 01 06:50:34 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (e030b143-b3c6-4462-a786-904115616f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3108736-b599-410d-8ad9-0d87d5f8cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3108736-b599-410d-8ad9-0d87d5f8cf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1857665026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f5eeb8-d682-4a74-ab29-6e0857fe5d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:35Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbe11b3-76be-4315-801a-a493efe59b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbe11b3-76be-4315-801a-a493efe59b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9c1e7b-05db-42f6-87e2-0852d73f38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9c1e7b-05db-42f6-87e2-0852d73f38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f5eeb8-d682-4a74-ab29-6e0857fe5d9b', 'volume_name': 'volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:35 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555de21a-e93a-4144-a655-bce455726322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555de21a-e93a-4144-a655-bce455726322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee34b29-3d2b-482b-9142-e7ba800d7eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:35 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Volume 28f5eeb8-d682-4a74-ab29-6e0857fe5d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b', 'volume_size': 1} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1857665026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f5eeb8-d682-4a74-ab29-6e0857fe5d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:35Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Creating volume 28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:35 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 is fetched for user 2d98acd2106b437985b3a11d5c377fba. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 06:50:35 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b 1073741824 Jul 01 06:50:35 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0008ad47-d98a-4873-a98f-c408cf8d495f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:35 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD Jul 01 06:50:35 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:36 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b 1073741824" returned: 0 in 1.034s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:36 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:36 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:50:36 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:37 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 0.745s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-957105756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2447d34-09dd-48ae-b7c9-5e68c21b2352,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:34Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Creating volume d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:37 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee34b29-3d2b-482b-9142-e7ba800d7eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:37 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 1073741824 Jul 01 06:50:37 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d3098e-2be7-44de-8140-6b2a06f4ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-8a3c66a1-8072-4209-b676-65b4e6856adb req-81f79761-be2f-427c-adbd-59bb9d2d2d4b tempest-AttachVolumeNegativeTest-757293942 None] Terminate volume connection completed successfully. Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8a3c66a1-8072-4209-b676-65b4e6856adb req-81f79761-be2f-427c-adbd-59bb9d2d2d4b tempest-AttachVolumeNegativeTest-757293942 None] Deleting attachment 27d1c8a3-2a51-404e-abed-70f34dfe0d95. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:50:37 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Volume volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b (28f5eeb8-d682-4a74-ab29-6e0857fe5d9b): created successfully Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d3098e-2be7-44de-8140-6b2a06f4ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (e030b143-b3c6-4462-a786-904115616f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f770e9c0-d2db-40c8-8225-acc2351aad02 tempest-VolumesSnapshotTestJSON-577538962 None] Created volume successfully. Jul 01 06:50:38 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 1073741824" returned: 0 in 0.908s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:38 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:50:38 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:38 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 0 in 0.689s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.246s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Creating offline snapshot 1164c980-c97f-4f2a-beb3-6eee6d2edcc2 of volume 28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a03dc22-09ca-49f2-8412-a98e024b8a5b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Attempting download of 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume d2447d34-09dd-48ae-b7c9-5e68c21b2352. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d3512-5ca8-48bd-848e-3531c1b7bb13]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:39 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:50:39 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:39 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09 Jul 01 06:50:39 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:39 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 0.948s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:39 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 1G Jul 01 06:50:39 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:39 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09" returned: 0 in 0.933s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:40 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09 Jul 01 06:50:40 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:41 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 1G" returned: 0 in 1.199s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:41 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 Jul 01 06:50:41 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:41 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09" returned: 1 in 1.160s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7mil9x09' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[14285e06-019f-4fc5-9bd2-ee5bb1dec8b1]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:41 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD Jul 01 06:50:41 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:41 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2" returned: 0 in 0.846s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:41 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 is being set with open permissions: ugo+rw Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:41 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 Jul 01 06:50:41 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:41 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 was qcow2, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 06:50:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:41 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:50:42 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:42 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2" returned: 0 in 0.825s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:42 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info Jul 01 06:50:42 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:43 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info" returned: 0 in 0.758s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:43 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info is being set with open permissions: ugo+rw Jul 01 06:50:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:43 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info Jul 01 06:50:43 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:44 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.info" returned: 0 in 0.729s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:44 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.431s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 0 in 2.303s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:44 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0ujemuzddevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:50:44 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Converted 112.00 MB image at 48.59 MB/s Jul 01 06:50:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:44 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 1G Jul 01 06:50:44 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7559a9bb-8d5a-490d-9e78-05fa95e5753d tempest-VolumesSnapshotTestJSON-577538962 None] Create snapshot completed successfully Jul 01 06:50:45 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 1G" returned: 0 in 0.847s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d221f2-e387-4f88-8c0e-4adc83379940]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:45 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:50:45 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (0e9dcbf6-5781-42fd-b2a2-3ad286364d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01a42dc-ff07-47eb-ab8e-df19abac729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01a42dc-ff07-47eb-ab8e-df19abac729d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-509862528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599bee15-32de-44c4-bae8-33fff1483295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1164c980-c97f-4f2a-beb3-6eee6d2edcc2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:46Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ac4fd0-6129-4fa2-8098-376b3bf98278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ac4fd0-6129-4fa2-8098-376b3bf98278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3d9e4b-6e48-49c6-8592-476f18cfe927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3d9e4b-6e48-49c6-8592-476f18cfe927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '599bee15-32de-44c4-bae8-33fff1483295', 'volume_name': 'volume-599bee15-32de-44c4-bae8-33fff1483295', 'volume_size': 2, 'snapshot_id': '1164c980-c97f-4f2a-beb3-6eee6d2edcc2'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1adf0b-7bd7-4e3f-a8d6-49a68b0b44f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1adf0b-7bd7-4e3f-a8d6-49a68b0b44f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893c6aea-91cc-4552-990b-e9053cab179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:45 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Volume 599bee15-32de-44c4-bae8-33fff1483295: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-599bee15-32de-44c4-bae8-33fff1483295', 'volume_size': 2, 'snapshot_id': '1164c980-c97f-4f2a-beb3-6eee6d2edcc2'} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-1164c980-c97f-4f2a-beb3-6eee6d2edcc2-599bee15-32de-44c4-bae8-33fff1483295" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-1164c980-c97f-4f2a-beb3-6eee6d2edcc2-599bee15-32de-44c4-bae8-33fff1483295" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Creating volume 599bee15-32de-44c4-bae8-33fff1483295 from snapshot 1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-599bee15-32de-44c4-bae8-33fff1483295" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-599bee15-32de-44c4-bae8-33fff1483295" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] snapshot: 1164c980-c97f-4f2a-beb3-6eee6d2edcc2, volume: 599bee15-32de-44c4-bae8-33fff1483295, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dcfdd1-4b76-4bfb-9d77-85dcbe8b8bbd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:46 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 0 in 1.011s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:46 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 Jul 01 06:50:46 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:46 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:50:46 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:46 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2" returned: 0 in 0.939s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0e05a2-e071-4905-9f26-2c8ea00331d4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:47 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 1 in 0.926s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Downloaded image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume d2447d34-09dd-48ae-b7c9-5e68c21b2352 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 for user 2d98acd2106b437985b3a11d5c377fba is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Marking volume d2447d34-09dd-48ae-b7c9-5e68c21b2352 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 06:50:47 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:50:47 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Copying metadata from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 to d2447d34-09dd-48ae-b7c9-5e68c21b2352. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Creating volume glance metadata for volume d2447d34-09dd-48ae-b7c9-5e68c21b2352 backed by image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb9b6b3-91d8-404f-a34e-7b45d84efbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b836e5b6-124e-471e-914f-a76bbae3c7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:47 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Volume volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 (d2447d34-09dd-48ae-b7c9-5e68c21b2352): created successfully Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b836e5b6-124e-471e-914f-a76bbae3c7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (0f8e7e68-9348-4571-a9f8-ba863eb6763d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c1277cda-f3b7-4be5-9d56-370e06014710 tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:50:48 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 1.080s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:48 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 Jul 01 06:50:48 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "cinder-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (9d2e56d6-bce3-4085-90b9-96de270e3ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dece902-95af-41b9-aca1-f5a4d1281953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dece902-95af-41b9-aca1-f5a4d1281953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1666973459',display_name='tempest-VolumesGetTest-Volume-891797191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1afaf3-cb31-4b59-9356-931a74c1886b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:48Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b54f347-5689-4448-9015-95369b4cb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b54f347-5689-4448-9015-95369b4cb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a00186-8f06-45fc-aab4-c9a93f067caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a00186-8f06-45fc-aab4-c9a93f067caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1afaf3-cb31-4b59-9356-931a74c1886b', 'volume_name': 'volume-6a1afaf3-cb31-4b59-9356-931a74c1886b', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78d68bd-c7d6-40b7-b9a4-1e6bc3b49810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78d68bd-c7d6-40b7-b9a4-1e6bc3b49810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ce4400-b878-471c-9d48-1fde5c0eea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Volume 6a1afaf3-cb31-4b59-9356-931a74c1886b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1afaf3-cb31-4b59-9356-931a74c1886b', 'volume_size': 1} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "cinder-quobyte-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-quobyte-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a8e620-46cc-4a73-bd0c-1bf0f408c921]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:48 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 Jul 01 06:50:48 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:50 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" returned: 0 in 1.383s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:50 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050 Jul 01 06:50:50 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:51 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" returned: 0 in 1.487s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-quobyte-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050" released by "delete_volume" :: held 2.937s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:51 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Created reservations ['2c40edf4-ec3c-48dd-879d-24edd21d99fc', '49d7e1a3-f3f6-4c04-adee-6c932891740a', '19fa2e94-41b7-4d17-80cb-60fef5c2b790', 'ce0f7738-306a-4eda-9eb3-062af87713b1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:52 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:52 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "cinder-0ff1c5c3-6bc1-4f82-b416-3415270c5d37-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-0ff1c5c3-6bc1-4f82-b416-3415270c5d37-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "cinder-quobyte-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-quobyte-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:53 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57e1c89-cfb0-4a9b-89df-f18f511048e5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:53 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 Jul 01 06:50:53 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:53 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.434s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:53 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:50:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Deleted volume successfully. Jul 01 06:50:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-24cd115c-50f7-4151-b651-6df5bdd46470 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-6f9eddbf-a3b1-4252-b8bb-fa30b7e4e050-delete_volume" released by "delete_volume" :: held 4.972s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:54 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295" returned: 0 in 6.210s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12ce036-af06-4cf7-835f-b4234592a16d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:54 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:50:54 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:54 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" returned: 0 in 1.921s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:54 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37 Jul 01 06:50:54 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:55 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 1.270s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:50:55 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Converted 1024.00 MB image at 164.78 MB/s Jul 01 06:50:55 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 is being set with open permissions: ugo+rw Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:55 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 Jul 01 06:50:55 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:55 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" returned: 0 in 0.766s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-quobyte-0ff1c5c3-6bc1-4f82-b416-3415270c5d37" released by "delete_volume" :: held 2.814s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Created reservations ['c3d85dfa-0689-4072-8ae6-60702eab7600', 'd5948bd2-9185-4e0f-a53d-899f940a1933', '064cc1ac-c6ad-4877-9eeb-d50720e371ca', '07b56039-2e80-4141-bcef-822ab1ddaeaf'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:55 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:55 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:56 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295" returned: 0 in 0.786s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-599bee15-32de-44c4-bae8-33fff1483295" released by "_copy_volume_from_snapshot" :: held 10.453s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-1164c980-c97f-4f2a-beb3-6eee6d2edcc2-599bee15-32de-44c4-bae8-33fff1483295" released by "_create_volume_from_snapshot" :: held 10.510s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.535s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.805s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:50:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1666973459',display_name='tempest-VolumesGetTest-Volume-891797191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1afaf3-cb31-4b59-9356-931a74c1886b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3c37e858f3497b80faccf29c6b1856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:50:48Z,use_quota=True,user_id='2d98acd2106b437985b3a11d5c377fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Creating volume 6a1afaf3-cb31-4b59-9356-931a74c1886b {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:50:56 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "cinder-3938a7fd-9434-47f6-a5ca-5581ba3f23a2-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:56 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b 1073741824 Jul 01 06:50:56 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-3938a7fd-9434-47f6-a5ca-5581ba3f23a2-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893c6aea-91cc-4552-990b-e9053cab179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599bee15-32de-44c4-bae8-33fff1483295', 'volume_size': 2, 'snapshot_id': '1164c980-c97f-4f2a-beb3-6eee6d2edcc2'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a28007-7117-4666-a9d1-7d4a402eb33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Volume volume-599bee15-32de-44c4-bae8-33fff1483295 (599bee15-32de-44c4-bae8-33fff1483295): created successfully Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a28007-7117-4666-a9d1-7d4a402eb33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:56 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (0e9dcbf6-5781-42fd-b2a2-3ad286364d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.894s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:50:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Deleted volume successfully. Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "cinder-quobyte-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ef1c669e-95d7-4c85-82e1-ebb46903aebc tempest-VolumesSnapshotTestJSON-577538962 None] Created volume successfully. Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a1b558a7-5bf3-4b2f-9126-55b7e5259408 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-0ff1c5c3-6bc1-4f82-b416-3415270c5d37-delete_volume" released by "delete_volume" :: held 4.201s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-quobyte-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" acquired by "delete_volume" :: waited 0.056s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a981675-824b-4d22-b8ec-e114abaeab3d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:57 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 Jul 01 06:50:57 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:57 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b 1073741824" returned: 0 in 1.184s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:57 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b Jul 01 06:50:57 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:58 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" returned: 0 in 1.125s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-599bee15-32de-44c4-bae8-33fff1483295-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:58 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2 Jul 01 06:50:58 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-599bee15-32de-44c4-bae8-33fff1483295-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-599bee15-32de-44c4-bae8-33fff1483295" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-599bee15-32de-44c4-bae8-33fff1483295" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb2e589-6b28-4931-aaf2-dfb8bd7c027e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:58 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 Jul 01 06:50:58 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:58 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b" returned: 0 in 1.094s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] <== create_volume: return (2372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ce4400-b878-471c-9d48-1fde5c0eea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1afaf3-cb31-4b59-9356-931a74c1886b', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfaa9d4-f0b8-4990-8a92-3bfca29fa05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:50:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Volume volume-6a1afaf3-cb31-4b59-9356-931a74c1886b (6a1afaf3-cb31-4b59-9356-931a74c1886b): created successfully Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfaa9d4-f0b8-4990-8a92-3bfca29fa05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:50:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Flow 'volume_create_manager' (9d2e56d6-bce3-4085-90b9-96de270e3ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:50:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b7956b25-e667-43e5-bb8e-53600185b0ff tempest-VolumesGetTest-1455123675 None] Created volume successfully. Jul 01 06:50:59 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" returned: 0 in 1.148s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-quobyte-3938a7fd-9434-47f6-a5ca-5581ba3f23a2" released by "delete_volume" :: held 2.324s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Created reservations ['b1911f9f-9bf6-4675-9f5a-8250edbd691f', '5e8bfd9c-1a5a-42bb-b2c5-20cc844598dd', '2de27e08-7c88-4c9b-bcd3-7dfb3bb89748', '52d497fa-4bc0-4da6-9896-6c70b77a5d00'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:59 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:50:59 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:50:59 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295" returned: 0 in 1.137s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:50:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:50:59 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295 Jul 01 06:50:59 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-6a1afaf3-cb31-4b59-9356-931a74c1886b-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Lock "cinder-6a1afaf3-cb31-4b59-9356-931a74c1886b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-6a1afaf3-cb31-4b59-9356-931a74c1886b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-6a1afaf3-cb31-4b59-9356-931a74c1886b" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a99ea46-58cc-4614-bb4f-33a3418b10eb]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:00 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.101s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:00 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Deleted volume successfully. Jul 01 06:51:00 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b Jul 01 06:51:00 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b2960779-d9bf-477f-804d-f0e60b74bf59 tempest-AttachVolumeNegativeTest-757293942 None] Lock "cinder-3938a7fd-9434-47f6-a5ca-5581ba3f23a2-delete_volume" released by "delete_volume" :: held 3.903s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:00 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-599bee15-32de-44c4-bae8-33fff1483295" returned: 0 in 1.068s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-599bee15-32de-44c4-bae8-33fff1483295" released by "delete_volume" :: held 2.314s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['49894199-38f6-4cea-a08f-2dd3fd0cd469', '491c63f4-bb17-4f22-9355-a8f43634ee77', 'f5222a7c-9c30-4557-b003-af383f8c4cba', 'ef716d41-cbd3-43ee-be43-c999a8a35eab'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:00 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:00 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:01 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b" returned: 0 in 1.297s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:01 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:01 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b Jul 01 06:51:01 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Deleted volume successfully. Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-1164c980-c97f-4f2a-beb3-6eee6d2edcc2-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-80b1f91b-128f-4782-b271-167bccede15e tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-599bee15-32de-44c4-bae8-33fff1483295-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-1164c980-c97f-4f2a-beb3-6eee6d2edcc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-1164c980-c97f-4f2a-beb3-6eee6d2edcc2" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-1164c980-c97f-4f2a-beb3-6eee6d2edcc2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Deleting offline snapshot 1164c980-c97f-4f2a-beb3-6eee6d2edcc2 of volume 28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] snapshot_file for this snap is: volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b2be79-7b6b-4d85-8c97-78d9b47df50d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:01 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 Jul 01 06:51:01 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:02 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a1afaf3-cb31-4b59-9356-931a74c1886b" returned: 0 in 0.863s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-6a1afaf3-cb31-4b59-9356-931a74c1886b" released by "delete_volume" :: held 2.263s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Created reservations ['73724e1e-84af-4c77-987f-d3a6e4f78817', '0bb7f734-0553-4cb6-b04e-2e15c9810bf5', 'b2d5c7ed-bbf0-4aa6-8a48-f03c41d9b49f', '6752733e-5769-4682-8829-e7a4e6df9509'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:02 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:02 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:02 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2" returned: 0 in 1.076s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a2a36-200b-4a1a-98be-36e875ec1085]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:03 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:51:03 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:03 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.790s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77ca4c72-78e0-4e3c-9572-0981be0763bb tempest-VolumesGetTest-1455123675 None] Lock "cinder-6a1afaf3-cb31-4b59-9356-931a74c1886b-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-d2447d34-09dd-48ae-b7c9-5e68c21b2352-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Lock "cinder-d2447d34-09dd-48ae-b7c9-5e68c21b2352-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Acquiring lock "cinder-quobyte-d2447d34-09dd-48ae-b7c9-5e68c21b2352" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-d2447d34-09dd-48ae-b7c9-5e68c21b2352" acquired by "delete_volume" :: waited 0.053s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:03 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 0.993s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c566c9b-c6c4-4477-9f5d-d4bdbd663a20]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:04 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 Jul 01 06:51:04 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:04 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:51:04 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:05 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2" returned: 0 in 1.165s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:05 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2 Jul 01 06:51:05 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:05 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 0 in 1.167s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:05 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:51:05 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:06 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b.1164c980-c97f-4f2a-beb3-6eee6d2edcc2" returned: 0 in 0.971s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-1164c980-c97f-4f2a-beb3-6eee6d2edcc2" released by "_delete_snapshot" :: held 4.322s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" released by "delete_snapshot" :: held 4.357s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:06 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 1 in 1.068s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['4a719405-91f7-4d1a-b08c-ad2f3b6a8ef3', '1d0b74f5-c622-494f-9bb4-1974a1dce27f', '15f42dcc-07d0-4a05-b29d-b982b0663cc9', '05f0b900-0cc9-4a7b-816f-386a1023ac21'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:06 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352 Jul 01 06:51:06 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Delete snapshot completed successfully. Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-77540ed5-0418-4e86-a891-4e5f5ed086e7 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-1164c980-c97f-4f2a-beb3-6eee6d2edcc2-delete_snapshot" released by "delete_snapshot" :: held 4.606s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:06 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d2447d34-09dd-48ae-b7c9-5e68c21b2352" returned: 0 in 0.758s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Lock "cinder-quobyte-d2447d34-09dd-48ae-b7c9-5e68c21b2352" released by "delete_volume" :: held 3.120s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Created reservations ['6f11b51f-cf37-4a08-a631-db4e995aa66c', '6c886c0b-0cf8-454b-b07d-7aeb0fab6dba', 'f8efe675-33e1-4fb3-8162-dfe21a952d3a', '1188c32c-9b8f-493b-bcd2-b66e2385da7c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:07 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:07 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" acquired by "delete_volume" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f66dd-007a-45f8-b003-fe93de99e632]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:07 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:51:07 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:08 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.990s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:08 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Deleted volume successfully. Jul 01 06:51:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7bea4817-41c4-468c-8d50-2820d376c271 tempest-VolumesGetTest-1455123675 None] Lock "cinder-d2447d34-09dd-48ae-b7c9-5e68c21b2352-delete_volume" released by "delete_volume" :: held 4.486s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:08 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 1.021s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:08 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b Jul 01 06:51:08 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:09 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b" released by "delete_volume" :: held 1.838s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['b5a2a4d1-5bdc-46f3-9f8a-4d66dd3e6394', '32c9cedb-f4d8-4321-b93a-92afa1f8c3b6', '9574dcfa-5566-4277-9b80-b71fd7ee72bc', '6e555cdd-7197-4788-b684-2be3ef110237'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:09 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:09 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:10 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.904s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:10 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Deleted volume successfully. Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ba27782e-963e-4586-84aa-3b1d976f1ce4 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-28f5eeb8-d682-4a74-ab29-6e0857fe5d9b-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Flow 'volume_create_manager' (04de8d18-66f7-4a9e-b24c-f29beb619962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5776299c-d276-4dec-bc47-c7669052a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5776299c-d276-4dec-bc47-c7669052a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1781402903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5cdf100-b829-4788-9366-f760ddd5c9c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a93f40bdbdfe43a1ac415c7cbdf2c0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:11Z,use_quota=True,user_id='ef7f653076484a67877fd74c5c884166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd426967-11ed-49d6-b9a3-d91a8a844c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd426967-11ed-49d6-b9a3-d91a8a844c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56600e96-1662-472b-a5fe-a0da07c6df26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56600e96-1662-472b-a5fe-a0da07c6df26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5cdf100-b829-4788-9366-f760ddd5c9c0', 'volume_name': 'volume-d5cdf100-b829-4788-9366-f760ddd5c9c0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4168541b-e7d6-4153-b053-a9379fc63795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4168541b-e7d6-4153-b053-a9379fc63795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3370817-bd5b-4807-ad10-09a7f74db8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Volume d5cdf100-b829-4788-9366-f760ddd5c9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5cdf100-b829-4788-9366-f760ddd5c9c0', 'volume_size': 1} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1781402903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5cdf100-b829-4788-9366-f760ddd5c9c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a93f40bdbdfe43a1ac415c7cbdf2c0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:11Z,use_quota=True,user_id='ef7f653076484a67877fd74c5c884166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Creating volume d5cdf100-b829-4788-9366-f760ddd5c9c0 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:10 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:10 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 1073741824 Jul 01 06:51:10 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (dc3e2998-a7b6-47de-ae09-131757a8a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97f10b8-289d-41c3-99fb-32a134212f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97f10b8-289d-41c3-99fb-32a134212f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247310558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31fd009-4358-482e-bdd2-28d033a3e077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:11Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a8cb2d-5aea-4b78-8b84-2f3f6bb0aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a8cb2d-5aea-4b78-8b84-2f3f6bb0aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb35133-ec91-4f80-94d8-831914ebdcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb35133-ec91-4f80-94d8-831914ebdcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31fd009-4358-482e-bdd2-28d033a3e077', 'volume_name': 'volume-f31fd009-4358-482e-bdd2-28d033a3e077', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2651a4e-499e-422e-aff5-12356b9c87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2651a4e-499e-422e-aff5-12356b9c87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91c3f5e-1202-45d4-a5bf-f236eaf7e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Volume f31fd009-4358-482e-bdd2-28d033a3e077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31fd009-4358-482e-bdd2-28d033a3e077', 'volume_size': 1} Jul 01 06:51:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:11 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 1073741824" returned: 0 in 0.908s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:11 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 Jul 01 06:51:11 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:12 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0" returned: 0 in 0.671s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247310558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31fd009-4358-482e-bdd2-28d033a3e077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:11Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Creating volume f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:12 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3370817-bd5b-4807-ad10-09a7f74db8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5cdf100-b829-4788-9366-f760ddd5c9c0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:12 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 1073741824 Jul 01 06:51:12 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea18271d-cd79-40c5-8804-f2a779f99fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Volume volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 (d5cdf100-b829-4788-9366-f760ddd5c9c0): created successfully Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea18271d-cd79-40c5-8804-f2a779f99fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Flow 'volume_create_manager' (04de8d18-66f7-4a9e-b24c-f29beb619962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-8f791038-aebe-46bd-9247-434f33450c5f req-b90ad224-8f90-4363-86ba-2ddbf9cf6682 tempest-VolumesGetTestJSON-1479598509 None] Created volume successfully. Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Acquiring lock "cinder-d5cdf100-b829-4788-9366-f760ddd5c9c0-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Lock "cinder-d5cdf100-b829-4788-9366-f760ddd5c9c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Acquiring lock "cinder-quobyte-d5cdf100-b829-4788-9366-f760ddd5c9c0" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Lock "cinder-quobyte-d5cdf100-b829-4788-9366-f760ddd5c9c0" acquired by "delete_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b3f5b8-635a-459c-870c-b86ba1bf45e0]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:13 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 Jul 01 06:51:13 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:13 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 1073741824" returned: 0 in 0.979s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:13 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:13 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Flow 'volume_create_manager' (ad3a6bde-52e1-4725-96c5-baf12a47b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fda64f9-6bb9-46e9-b129-16c53ba3fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fda64f9-6bb9-46e9-b129-16c53ba3fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844966746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c27ceb-d4a8-4d60-a783-f4d256ddc91a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7241473fbe428fbcb661a21cde7a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:14Z,use_quota=True,user_id='848724e9c6ef415b817a839c12404530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d412dd8-dab9-4f18-8ee2-533800f9133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d412dd8-dab9-4f18-8ee2-533800f9133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2561af-dc20-4337-9c78-0cf05cd354f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2561af-dc20-4337-9c78-0cf05cd354f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c27ceb-d4a8-4d60-a783-f4d256ddc91a', 'volume_name': 'volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38eb2d5-ea57-4c00-8b3c-0c545b6f186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38eb2d5-ea57-4c00-8b3c-0c545b6f186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bf484f-4085-4fe8-bf74-f0cd3408ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:13 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Volume 83c27ceb-d4a8-4d60-a783-f4d256ddc91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a', 'volume_size': 1} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:13 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0" returned: 0 in 0.824s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:13 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0 Jul 01 06:51:13 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:14 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844966746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c27ceb-d4a8-4d60-a783-f4d256ddc91a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7241473fbe428fbcb661a21cde7a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:14Z,use_quota=True,user_id='848724e9c6ef415b817a839c12404530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Creating volume 83c27ceb-d4a8-4d60-a783-f4d256ddc91a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:14 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:14 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a 1073741824 Jul 01 06:51:14 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91c3f5e-1202-45d4-a5bf-f236eaf7e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31fd009-4358-482e-bdd2-28d033a3e077', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d05f6c-aa1c-46f7-8fad-f49e77f538ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:14 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Volume volume-f31fd009-4358-482e-bdd2-28d033a3e077 (f31fd009-4358-482e-bdd2-28d033a3e077): created successfully Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d05f6c-aa1c-46f7-8fad-f49e77f538ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (dc3e2998-a7b6-47de-ae09-131757a8a314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-896c2df2-15b7-466c-a84b-451a052f3b7c tempest-VolumesSnapshotTestJSON-577538962 None] Created volume successfully. Jul 01 06:51:14 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d5cdf100-b829-4788-9366-f760ddd5c9c0" returned: 0 in 0.669s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Lock "cinder-quobyte-d5cdf100-b829-4788-9366-f760ddd5c9c0" released by "delete_volume" :: held 1.542s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.quota [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Created reservations ['9a18bf28-c6f6-434c-a9d5-3ecc52825134', 'd3fecf7c-3ad3-41e9-b34d-f11a409b0ac8', 'f34bb402-4263-46f9-83ec-0cf5d30b84f6', '780877d7-aa1b-4d82-be0a-44e4278da311'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:14 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:14 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:15 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a 1073741824" returned: 0 in 0.957s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:15 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a Jul 01 06:51:15 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:15 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.780s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.manager [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Deleted volume successfully. Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-3cfeb98c-42af-403a-b803-889455d38441 req-ebd3c166-37be-4aa5-9bb0-9935606ae281 tempest-VolumesGetTestJSON-1479598509 None] Lock "cinder-d5cdf100-b829-4788-9366-f760ddd5c9c0-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:15 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a" returned: 0 in 0.877s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.019s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Creating offline snapshot 8d1bf896-2ee1-4aeb-ae39-b22fb988b51f of volume f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bf484f-4085-4fe8-bf74-f0cd3408ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412b4a46-8634-4480-a085-550197ce236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aed6ca-1b72-4aeb-9ba4-af7499f576ba]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:15 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Volume volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a (83c27ceb-d4a8-4d60-a783-f4d256ddc91a): created successfully Jul 01 06:51:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412b4a46-8634-4480-a085-550197ce236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Flow 'volume_create_manager' (ad3a6bde-52e1-4725-96c5-baf12a47b27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1d9f6e29-59ce-4e67-905a-6d77e1361137 tempest-VolumesListTestJSON-419662527 None] Created volume successfully. Jul 01 06:51:16 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:16 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:16 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 0.932s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:16 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f 1G Jul 01 06:51:16 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=144,cinder:SELECT=117,cinder:DELETE=8,cinder:INSERT=39 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=133,cinder:INSERT=38,cinder:SELECT=113,cinder:DELETE=16 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Flow 'volume_create_manager' (4b5e85ba-ada7-4e86-8669-d10c097e2a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4181836a-f975-4a1e-b07f-f7181005f33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4181836a-f975-4a1e-b07f-f7181005f33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-11173163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dbfde9-dc11-476e-bd04-aa2bea21bea7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7241473fbe428fbcb661a21cde7a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:17Z,use_quota=True,user_id='848724e9c6ef415b817a839c12404530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d0643f-355f-4a14-beb3-63b2e4ba1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d0643f-355f-4a14-beb3-63b2e4ba1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd23d5e-b194-445d-8ced-79852518fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd23d5e-b194-445d-8ced-79852518fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46dbfde9-dc11-476e-bd04-aa2bea21bea7', 'volume_name': 'volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec2550d-a340-4061-81e6-7d6b1b8f197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec2550d-a340-4061-81e6-7d6b1b8f197e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60fff69-ae47-49af-8a74-b4ecabab42e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Volume 46dbfde9-dc11-476e-bd04-aa2bea21bea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7', 'volume_size': 1} Jul 01 06:51:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:18 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f 1G" returned: 0 in 1.107s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31fd009-4358-482e-bdd2-28d033a3e077 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:18 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31fd009-4358-482e-bdd2-28d033a3e077 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f Jul 01 06:51:18 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:18 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31fd009-4358-482e-bdd2-28d033a3e077 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" returned: 0 in 0.754s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:18 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f is being set with open permissions: ugo+rw Jul 01 06:51:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:18 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f Jul 01 06:51:18 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Flow 'volume_create_manager' (717c39ff-630a-4f49-8c66-b4575a8ec086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91530d8d-c4d1-4100-b8dd-6cdf5cbdaa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91530d8d-c4d1-4100-b8dd-6cdf5cbdaa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1747848389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de73a17-09b7-4f88-9291-52ed4032ca10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f2834707344c3a89e14292ed4b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:19Z,use_quota=True,user_id='a99027a1a4654ef1a76087da64dcf44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0dd736a-1c8a-4d56-a7bc-5583cffedd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0dd736a-1c8a-4d56-a7bc-5583cffedd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b10124-5f27-404a-905b-4360be647922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b10124-5f27-404a-905b-4360be647922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de73a17-09b7-4f88-9291-52ed4032ca10', 'volume_name': 'volume-8de73a17-09b7-4f88-9291-52ed4032ca10', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37657a00-2cd7-4691-8319-1451e9d859e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37657a00-2cd7-4691-8319-1451e9d859e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b72c2f-ebe9-4404-87ab-1ef1ab8439ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Volume 8de73a17-09b7-4f88-9291-52ed4032ca10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de73a17-09b7-4f88-9291-52ed4032ca10', 'volume_size': 1} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:19 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" returned: 0 in 0.698s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:19 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info Jul 01 06:51:19 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Flow 'volume_create_manager' (3df437d5-d6f2-4106-a89c-448c8b8aea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9cd8dfe-f8f9-4628-9944-de4c521b88db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9cd8dfe-f8f9-4628-9944-de4c521b88db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1441179659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85500de1-3301-4e23-9979-21aa5591dc3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5dcb14931e4b319bae64efcc89629d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:20Z,use_quota=True,user_id='761f7686fc52482e8675d3dcfc56e375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665508f8-387d-466d-a3c8-d10d055e81c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665508f8-387d-466d-a3c8-d10d055e81c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8635899-7b81-4275-af05-be574e3d622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8635899-7b81-4275-af05-be574e3d622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85500de1-3301-4e23-9979-21aa5591dc3f', 'volume_name': 'volume-85500de1-3301-4e23-9979-21aa5591dc3f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab75a0c-2b86-4218-86c1-d5ce4b08d7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab75a0c-2b86-4218-86c1-d5ce4b08d7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bb1813-8a66-43b4-9780-254ebd5c7002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Volume 85500de1-3301-4e23-9979-21aa5591dc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85500de1-3301-4e23-9979-21aa5591dc3f', 'volume_size': 1} Jul 01 06:51:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:20 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info" returned: 0 in 0.661s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:20 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info is being set with open permissions: ugo+rw Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:20 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info Jul 01 06:51:20 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:20 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.info" returned: 0 in 0.673s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.931s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.216s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-11173163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dbfde9-dc11-476e-bd04-aa2bea21bea7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7241473fbe428fbcb661a21cde7a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:17Z,use_quota=True,user_id='848724e9c6ef415b817a839c12404530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Creating volume 46dbfde9-dc11-476e-bd04-aa2bea21bea7 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:20 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:20 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 1073741824 Jul 01 06:51:20 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-19695d57-ea34-4fb3-b88a-f778f271093c tempest-VolumesSnapshotTestJSON-577538962 None] Create snapshot completed successfully Jul 01 06:51:21 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 1073741824" returned: 0 in 0.899s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (32e1aa47-8c35-479d-84fa-171d9dd55fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121255e-b5d3-4460-862c-0cfe412b4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121255e-b5d3-4460-862c-0cfe412b4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1350843931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dc168f-a594-435b-88e2-344cf90a871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b121fc71f83b4dfc979e21f3354c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d1bf896-2ee1-4aeb-ae39-b22fb988b51f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:22Z,use_quota=True,user_id='cf5989fb09b54423af622f87618a6235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:21 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 Jul 01 06:51:21 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36cd4d0b-ce3c-44fb-ba87-f85702b60af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36cd4d0b-ce3c-44fb-ba87-f85702b60af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff232c44-cee0-442e-9af8-110e0530148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff232c44-cee0-442e-9af8-110e0530148b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0dc168f-a594-435b-88e2-344cf90a871e', 'volume_name': 'volume-c0dc168f-a594-435b-88e2-344cf90a871e', 'volume_size': 1, 'snapshot_id': '8d1bf896-2ee1-4aeb-ae39-b22fb988b51f'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dc43d5-c7f2-4ed5-b15a-c4f33fca233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dc43d5-c7f2-4ed5-b15a-c4f33fca233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20393809-cd03-47a4-ab54-a1b647e66c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Volume c0dc168f-a594-435b-88e2-344cf90a871e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0dc168f-a594-435b-88e2-344cf90a871e', 'volume_size': 1, 'snapshot_id': '8d1bf896-2ee1-4aeb-ae39-b22fb988b51f'} Jul 01 06:51:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:22 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7" returned: 0 in 0.643s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1747848389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de73a17-09b7-4f88-9291-52ed4032ca10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f2834707344c3a89e14292ed4b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:19Z,use_quota=True,user_id='a99027a1a4654ef1a76087da64dcf44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Creating volume 8de73a17-09b7-4f88-9291-52ed4032ca10 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:22 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:22 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 1073741824 Jul 01 06:51:22 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60fff69-ae47-49af-8a74-b4ecabab42e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec953ac1-28e5-4828-b812-d91382b6888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:22 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Volume volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 (46dbfde9-dc11-476e-bd04-aa2bea21bea7): created successfully Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec953ac1-28e5-4828-b812-d91382b6888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Flow 'volume_create_manager' (4b5e85ba-ada7-4e86-8669-d10c097e2a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c9c0c1b9-f651-4838-bff2-9a4a55d0b2bd tempest-VolumesListTestJSON-419662527 None] Created volume successfully. Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Flow 'volume_create_manager' (b129f031-c23b-4bc5-ad33-21740ba32bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1503ab18-c3d5-441c-96ed-6a136f0e0a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1503ab18-c3d5-441c-96ed-6a136f0e0a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1587386271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a69c4d-9e73-4638-acb1-188115ce3aef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7241473fbe428fbcb661a21cde7a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:23Z,use_quota=True,user_id='848724e9c6ef415b817a839c12404530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ac8afd-dbf4-4be7-ac20-9e5be7bb2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ac8afd-dbf4-4be7-ac20-9e5be7bb2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f786777b-a719-4fe8-af76-daa9edad5314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f786777b-a719-4fe8-af76-daa9edad5314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a69c4d-9e73-4638-acb1-188115ce3aef', 'volume_name': 'volume-57a69c4d-9e73-4638-acb1-188115ce3aef', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad5a6d5-5aa6-4dc3-a1a9-371365cd5fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad5a6d5-5aa6-4dc3-a1a9-371365cd5fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ff5a2-6ae6-4529-bd2f-079775b12e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:23 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Volume 57a69c4d-9e73-4638-acb1-188115ce3aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a69c4d-9e73-4638-acb1-188115ce3aef', 'volume_size': 1} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:23 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 1073741824" returned: 0 in 0.869s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:23 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 Jul 01 06:51:23 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:24 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10" returned: 0 in 0.657s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.255s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1441179659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85500de1-3301-4e23-9979-21aa5591dc3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5dcb14931e4b319bae64efcc89629d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:20Z,use_quota=True,user_id='761f7686fc52482e8675d3dcfc56e375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Creating volume 85500de1-3301-4e23-9979-21aa5591dc3f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:24 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:24 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f 1073741824 Jul 01 06:51:24 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b72c2f-ebe9-4404-87ab-1ef1ab8439ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de73a17-09b7-4f88-9291-52ed4032ca10', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf685fd-c9ab-4139-bb9d-7a99453babbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:24 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Volume volume-8de73a17-09b7-4f88-9291-52ed4032ca10 (8de73a17-09b7-4f88-9291-52ed4032ca10): created successfully Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf685fd-c9ab-4139-bb9d-7a99453babbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Flow 'volume_create_manager' (717c39ff-630a-4f49-8c66-b4575a8ec086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:24 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8f73ad5c-4340-4986-ba65-e7b3db2cb389 tempest-AttachVolumeTestJSON-1369393165 None] Created volume successfully. Jul 01 06:51:24 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f 1073741824" returned: 0 in 0.851s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:24 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f Jul 01 06:51:24 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:25 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f" returned: 0 in 0.633s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.673s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f-c0dc168f-a594-435b-88e2-344cf90a871e" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bb1813-8a66-43b4-9780-254ebd5c7002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85500de1-3301-4e23-9979-21aa5591dc3f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73644aa-6e2b-4519-a05b-61833c5a9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f-c0dc168f-a594-435b-88e2-344cf90a871e" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Creating volume c0dc168f-a594-435b-88e2-344cf90a871e from snapshot 8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-c0dc168f-a594-435b-88e2-344cf90a871e" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:25 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Volume volume-85500de1-3301-4e23-9979-21aa5591dc3f (85500de1-3301-4e23-9979-21aa5591dc3f): created successfully Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73644aa-6e2b-4519-a05b-61833c5a9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Flow 'volume_create_manager' (3df437d5-d6f2-4106-a89c-448c8b8aea9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-c0dc168f-a594-435b-88e2-344cf90a871e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] snapshot: 8d1bf896-2ee1-4aeb-ae39-b22fb988b51f, volume: c0dc168f-a594-435b-88e2-344cf90a871e, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:51:25 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-6f0be636-22be-4366-ba24-df4b9ed0fa67 tempest-VolumesTestJSON-2104203147 None] Created volume successfully. Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be41f8f-b7d5-4b4e-bd59-ae691157e33d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:25 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f Jul 01 06:51:25 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:26 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:26 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:26 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" returned: 0 in 0.789s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31fd009-4358-482e-bdd2-28d033a3e077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cbd852-33c7-4b0d-8385-fd0cb08e1344]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Flow 'volume_create_manager' (c7bc05bf-9cc9-4560-a668-71924b08ebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6314f4cd-c88a-4606-8a8d-1366e2956c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6314f4cd-c88a-4606-8a8d-1366e2956c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1287862299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a07b6f-be64-4ccc-b20e-f70f8af4879f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5dcb14931e4b319bae64efcc89629d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:27Z,use_quota=True,user_id='761f7686fc52482e8675d3dcfc56e375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d4a7bb-d64f-4546-baa0-b4cc7510bf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d4a7bb-d64f-4546-baa0-b4cc7510bf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f8e364-634b-48ec-aa2e-3b8d9464a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f8e364-634b-48ec-aa2e-3b8d9464a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a07b6f-be64-4ccc-b20e-f70f8af4879f', 'volume_name': 'volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e920634c-b3ff-494a-8a44-1191ecf0a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e920634c-b3ff-494a-8a44-1191ecf0a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:26 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:26 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a234f22c-7642-4be2-9eff-6d42926dc797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:26 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Volume 62a07b6f-be64-4ccc-b20e-f70f8af4879f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f', 'volume_size': 1} Jul 01 06:51:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:27 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.700s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:51:27 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 0.809s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:27 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e Jul 01 06:51:27 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:32 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e" returned: 0 in 4.733s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:32 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d373d-7cf8-4399-af49-4e634f21efa5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:32 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:32 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:32 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 0.888s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:32 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:51:32 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Converted 1024.00 MB image at 216.33 MB/s Jul 01 06:51:32 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e is being set with open permissions: ugo+rw Jul 01 06:51:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:32 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e Jul 01 06:51:32 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:33 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e" returned: 0 in 0.633s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-c0dc168f-a594-435b-88e2-344cf90a871e" released by "_copy_volume_from_snapshot" :: held 7.959s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f-c0dc168f-a594-435b-88e2-344cf90a871e" released by "_create_volume_from_snapshot" :: held 8.003s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.038s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.266s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1587386271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a69c4d-9e73-4638-acb1-188115ce3aef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7241473fbe428fbcb661a21cde7a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:23Z,use_quota=True,user_id='848724e9c6ef415b817a839c12404530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Creating volume 57a69c4d-9e73-4638-acb1-188115ce3aef {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:33 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:33 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef 1073741824 Jul 01 06:51:33 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20393809-cd03-47a4-ab54-a1b647e66c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0dc168f-a594-435b-88e2-344cf90a871e', 'volume_size': 1, 'snapshot_id': '8d1bf896-2ee1-4aeb-ae39-b22fb988b51f'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb15f99-3ec6-47fb-9e5f-1e6957c82635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:33 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Volume volume-c0dc168f-a594-435b-88e2-344cf90a871e (c0dc168f-a594-435b-88e2-344cf90a871e): created successfully Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb15f99-3ec6-47fb-9e5f-1e6957c82635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Flow 'volume_create_manager' (32e1aa47-8c35-479d-84fa-171d9dd55fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-06060ac7-7523-4fed-83ec-e08d7a6c8648 tempest-VolumesSnapshotTestJSON-577538962 None] Created volume successfully. Jul 01 06:51:34 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef 1073741824" returned: 0 in 0.790s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:34 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef Jul 01 06:51:34 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-c0dc168f-a594-435b-88e2-344cf90a871e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-c0dc168f-a594-435b-88e2-344cf90a871e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-c0dc168f-a594-435b-88e2-344cf90a871e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-c0dc168f-a594-435b-88e2-344cf90a871e" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d58839-c8c3-485f-aa61-f92216a3dd37]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:34 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e Jul 01 06:51:34 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:35 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef" returned: 0 in 0.695s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.489s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1287862299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a07b6f-be64-4ccc-b20e-f70f8af4879f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5dcb14931e4b319bae64efcc89629d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:27Z,use_quota=True,user_id='761f7686fc52482e8675d3dcfc56e375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Creating volume 62a07b6f-be64-4ccc-b20e-f70f8af4879f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:35 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:35 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f 1073741824 Jul 01 06:51:35 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ff5a2-6ae6-4529-bd2f-079775b12e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a69c4d-9e73-4638-acb1-188115ce3aef', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01de072d-4cd1-4489-b909-b89528abac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:35 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Volume volume-57a69c4d-9e73-4638-acb1-188115ce3aef (57a69c4d-9e73-4638-acb1-188115ce3aef): created successfully Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01de072d-4cd1-4489-b909-b89528abac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Flow 'volume_create_manager' (b129f031-c23b-4bc5-ad33-21740ba32bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-efc1e851-0db4-4c97-9684-3430d1ce3484 tempest-VolumesListTestJSON-419662527 None] Created volume successfully. Jul 01 06:51:35 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e" returned: 0 in 0.818s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:35 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e Jul 01 06:51:35 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:36 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f 1073741824" returned: 0 in 0.850s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:36 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f Jul 01 06:51:36 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:36 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c0dc168f-a594-435b-88e2-344cf90a871e" returned: 0 in 0.670s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-c0dc168f-a594-435b-88e2-344cf90a871e" released by "delete_volume" :: held 1.540s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['be1fec0f-ab8f-4413-acfb-10b81b4bcd9b', 'ab376d6d-dc02-44a2-8c70-d3ab256eac9f', 'a4e2dc48-2aca-4be5-a124-697a537977f1', '1fa27f8f-882f-4ecb-b668-75ead966aece'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:36 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:36 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:36 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f" returned: 0 in 0.663s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.179s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a234f22c-7642-4be2-9eff-6d42926dc797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a2f22b-f758-4222-9fac-ae986681f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1850acca-61e5-4e5c-8e56-f1daef896d0f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:36 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Volume volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f (62a07b6f-be64-4ccc-b20e-f70f8af4879f): created successfully Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a2f22b-f758-4222-9fac-ae986681f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Flow 'volume_create_manager' (c7bc05bf-9cc9-4560-a668-71924b08ebe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9ab373ee-acfc-454d-9b9b-cec007547928 tempest-VolumesTestJSON-2104203147 None] Created volume successfully. Jul 01 06:51:36 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 Jul 01 06:51:36 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:37 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.703s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Deleted volume successfully. Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-76af567b-eec6-468d-ba8e-8d88688e9745 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-c0dc168f-a594-435b-88e2-344cf90a871e-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-f31fd009-4358-482e-bdd2-28d033a3e077" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-f31fd009-4358-482e-bdd2-28d033a3e077" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Deleting offline snapshot 8d1bf896-2ee1-4aeb-ae39-b22fb988b51f of volume f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] snapshot_file for this snap is: volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b97775a-125e-436e-af53-19e5381e9f5f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:37 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10" returned: 0 in 0.825s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:37 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f Jul 01 06:51:37 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-8de73a17-09b7-4f88-9291-52ed4032ca10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90fda724-f644-454a-be80-633f58ea7aa8', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:51:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-ec03e347-8e0e-4cea-9d2f-b30ee99057a6 req-6d59260d-cfc6-4392-a315-98c11893c669 tempest-AttachVolumeTestJSON-1369393165 None] attachment_update completed successfully. Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Flow 'volume_create_manager' (fcd0a9ca-553b-4690-b88f-76f3bd43a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84882aec-8762-4b27-a6b3-05a2ec129223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84882aec-8762-4b27-a6b3-05a2ec129223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1364074571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb9f72-7938-4087-89ac-8167ce7d4756,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5dcb14931e4b319bae64efcc89629d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:38Z,use_quota=True,user_id='761f7686fc52482e8675d3dcfc56e375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6b018a-ab36-4a75-acb4-6229fc7f3cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6b018a-ab36-4a75-acb4-6229fc7f3cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada63967-09e7-4a38-a220-1e1a99415571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada63967-09e7-4a38-a220-1e1a99415571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cb9f72-7938-4087-89ac-8167ce7d4756', 'volume_name': 'volume-58cb9f72-7938-4087-89ac-8167ce7d4756', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:38 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67c9090-62f7-492d-9a68-1e2e79dba698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67c9090-62f7-492d-9a68-1e2e79dba698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5dfea2-004c-4ee7-bfa9-2f5740a2a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:38 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Volume 58cb9f72-7938-4087-89ac-8167ce7d4756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cb9f72-7938-4087-89ac-8167ce7d4756', 'volume_size': 1} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1364074571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb9f72-7938-4087-89ac-8167ce7d4756,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5dcb14931e4b319bae64efcc89629d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:38Z,use_quota=True,user_id='761f7686fc52482e8675d3dcfc56e375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Creating volume 58cb9f72-7938-4087-89ac-8167ce7d4756 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:38 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" returned: 0 in 1.015s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31fd009-4358-482e-bdd2-28d033a3e077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:51:38 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 1073741824 Jul 01 06:51:38 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff10246-15ab-4caf-9ab8-a83091194fb7]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:38 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:38 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:39 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 0.893s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:39 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f Jul 01 06:51:39 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "cinder-57a69c4d-9e73-4638-acb1-188115ce3aef-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-57a69c4d-9e73-4638-acb1-188115ce3aef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "cinder-quobyte-57a69c4d-9e73-4638-acb1-188115ce3aef" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:39 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 1073741824" returned: 0 in 1.163s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-quobyte-57a69c4d-9e73-4638-acb1-188115ce3aef" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b3d610-6d4b-45c6-be14-e2c221b0aa65]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:39 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 Jul 01 06:51:39 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:39 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef Jul 01 06:51:39 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:40 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:40 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f Jul 01 06:51:40 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:40 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756" returned: 0 in 0.733s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5dfea2-004c-4ee7-bfa9-2f5740a2a838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cb9f72-7938-4087-89ac-8167ce7d4756', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0fc086-a60a-4584-88c8-fc8d5fe6e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Volume volume-58cb9f72-7938-4087-89ac-8167ce7d4756 (58cb9f72-7938-4087-89ac-8167ce7d4756): created successfully Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0fc086-a60a-4584-88c8-fc8d5fe6e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Flow 'volume_create_manager' (fcd0a9ca-553b-4690-b88f-76f3bd43a917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-46b6ad4b-ca68-40ba-9dd2-9bc10bad0526 tempest-VolumesTestJSON-2104203147 None] Created volume successfully. Jul 01 06:51:40 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:40 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef Jul 01 06:51:40 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:41 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077.8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" returned: 0 in 0.729s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f" released by "_delete_snapshot" :: held 3.642s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-f31fd009-4358-482e-bdd2-28d033a3e077" released by "delete_snapshot" :: held 3.673s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['6e7d012e-aff1-49b2-962c-2119240189c4', 'aea962c1-0a47-4a69-9d9f-8d2e79d1bc7c', '407001b7-f01c-49eb-88ed-2dfd62bcaf38', '3c192478-1856-42ac-b8a3-7ebc0729908b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:41 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Delete snapshot completed successfully. Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f91bd992-ed54-4307-89a6-779d91446083 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-8d1bf896-2ee1-4aeb-ae39-b22fb988b51f-delete_snapshot" released by "delete_snapshot" :: held 3.824s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:41 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-57a69c4d-9e73-4638-acb1-188115ce3aef" returned: 0 in 0.716s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-quobyte-57a69c4d-9e73-4638-acb1-188115ce3aef" released by "delete_volume" :: held 1.631s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Created reservations ['5026787d-2787-4d13-852e-e025b429ec27', '924b497b-b215-41b4-aedd-f32b9afd6bf4', 'de1ddd0c-500f-4548-9273-4b81c68298ea', 'f20fca76-ce6a-4eb2-a457-5617735e3ec9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:41 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:41 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "cinder-46dbfde9-dc11-476e-bd04-aa2bea21bea7-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-46dbfde9-dc11-476e-bd04-aa2bea21bea7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "cinder-quobyte-46dbfde9-dc11-476e-bd04-aa2bea21bea7" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-f31fd009-4358-482e-bdd2-28d033a3e077-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-quobyte-46dbfde9-dc11-476e-bd04-aa2bea21bea7" acquired by "delete_volume" :: waited 0.050s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[107bf215-82e3-4eaf-9e53-f53ade6c1f63]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-f31fd009-4358-482e-bdd2-28d033a3e077-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:42 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-f31fd009-4358-482e-bdd2-28d033a3e077" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.783s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:42 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Deleted volume successfully. Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-f31fd009-4358-482e-bdd2-28d033a3e077" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a746d0cf-60d7-4666-9434-6cc0b1cf6773 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-57a69c4d-9e73-4638-acb1-188115ce3aef-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26b3ca3-9844-4366-9f4f-5005cac4d922]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:42 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 Jul 01 06:51:42 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:42 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:42 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Acquiring lock "cinder-58cb9f72-7938-4087-89ac-8167ce7d4756-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Lock "cinder-58cb9f72-7938-4087-89ac-8167ce7d4756-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Acquiring lock "cinder-quobyte-58cb9f72-7938-4087-89ac-8167ce7d4756" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Lock "cinder-quobyte-58cb9f72-7938-4087-89ac-8167ce7d4756" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f564c1-3b59-4096-9a0e-7af06b8957cc]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:42 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 Jul 01 06:51:42 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:43 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7" returned: 0 in 0.860s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:43 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7 Jul 01 06:51:43 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:43 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 1.070s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:43 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077 Jul 01 06:51:43 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Flow 'volume_create_manager' (9e235d64-8cbb-44e7-b1e4-b27aa94ad15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dadee2-e387-4ba2-bc16-75e16d318726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dadee2-e387-4ba2-bc16-75e16d318726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-286862912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20160b3a-dae9-4e71-920c-50e85ad4a0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f2834707344c3a89e14292ed4b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:43Z,use_quota=True,user_id='a99027a1a4654ef1a76087da64dcf44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f7940a-8e46-4804-90ae-42d9f6b8c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f7940a-8e46-4804-90ae-42d9f6b8c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a0f3fa-e51f-45cb-b27a-b9af1ae07059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a0f3fa-e51f-45cb-b27a-b9af1ae07059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20160b3a-dae9-4e71-920c-50e85ad4a0ff', 'volume_name': 'volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3e098d-f5da-4529-adb1-75aeb2145b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3e098d-f5da-4529-adb1-75aeb2145b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6a4f66-d098-4fc8-b10d-201c87005b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:43 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Volume 20160b3a-dae9-4e71-920c-50e85ad4a0ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff', 'volume_size': 1} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-286862912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20160b3a-dae9-4e71-920c-50e85ad4a0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f2834707344c3a89e14292ed4b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:43Z,use_quota=True,user_id='a99027a1a4654ef1a76087da64dcf44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Creating volume 20160b3a-dae9-4e71-920c-50e85ad4a0ff {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:43 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:43 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff 1073741824 Jul 01 06:51:43 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:43 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756" returned: 0 in 0.887s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:43 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756 Jul 01 06:51:43 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:43 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-46dbfde9-dc11-476e-bd04-aa2bea21bea7" returned: 0 in 0.790s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-quobyte-46dbfde9-dc11-476e-bd04-aa2bea21bea7" released by "delete_volume" :: held 1.732s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Created reservations ['47619697-57fd-4c32-973b-3f1edec03044', '1e8383a9-528b-4100-a55b-fc9520a2f612', 'cf618a0c-06c7-4aea-bff6-31f857eef1bb', 'e8780005-e691-4a49-870b-91ac1726a739'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:43 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:44 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:44 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f31fd009-4358-482e-bdd2-28d033a3e077" returned: 0 in 0.758s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-f31fd009-4358-482e-bdd2-28d033a3e077" released by "delete_volume" :: held 1.906s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['5c90e0ab-237e-4aaf-af98-0b51b4752e44', '5a9d970c-8dae-44fd-b073-2425e4a1f342', '7f2c4b95-c6e4-4471-97a2-ebef670aa5aa', '651a89b5-b0d7-4790-9987-71b4c057d4c1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:44 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58cb9f72-7938-4087-89ac-8167ce7d4756" returned: 0 in 0.812s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:44 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:44 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Lock "cinder-quobyte-58cb9f72-7938-4087-89ac-8167ce7d4756" released by "delete_volume" :: held 1.775s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Created reservations ['5e008f54-2ffa-4ea3-b69e-c222972f5c51', 'd991e528-670f-4bb3-ba35-9a98591f4778', 'ad3b0f86-22d2-4474-afe0-3de9085a3461', '02e00bda-64a6-479a-a7e2-5e26eef54ee6'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "cinder-83c27ceb-d4a8-4d60-a783-f4d256ddc91a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-02411e9a-3cae-4f48-b521-5e6ab362561d-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-83c27ceb-d4a8-4d60-a783-f4d256ddc91a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-02411e9a-3cae-4f48-b521-5e6ab362561d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "cinder-quobyte-83c27ceb-d4a8-4d60-a783-f4d256ddc91a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "cinder-quobyte-02411e9a-3cae-4f48-b521-5e6ab362561d" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:44 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-02411e9a-3cae-4f48-b521-5e6ab362561d" acquired by "delete_volume" :: waited 0.049s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:44 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:44 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-quobyte-83c27ceb-d4a8-4d60-a783-f4d256ddc91a" acquired by "delete_volume" :: waited 0.099s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f48383c-2636-4818-8a12-d0046a9eb719]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "cinder-62a07b6f-be64-4ccc-b20e-f70f8af4879f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff 1073741824" returned: 0 in 1.404s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e8ee70-97e0-4560-b14c-144335f762a6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:44 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.025s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:44 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-62a07b6f-be64-4ccc-b20e-f70f8af4879f-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Deleted volume successfully. Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:45 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d Jul 01 06:51:45 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-5fc1f9a4-9070-4048-8bf4-fd44fd4de0e2 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-46dbfde9-dc11-476e-bd04-aa2bea21bea7-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "cinder-quobyte-62a07b6f-be64-4ccc-b20e-f70f8af4879f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:45 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff Jul 01 06:51:45 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-quobyte-62a07b6f-be64-4ccc-b20e-f70f8af4879f" acquired by "delete_volume" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:45 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a Jul 01 06:51:45 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9736b-b290-4c95-bbc1-6730e4d35fdd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:45 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f Jul 01 06:51:45 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:45 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.184s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Deleted volume successfully. Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0563a3e2-9876-418e-abe9-ef7039dc1b83 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-f31fd009-4358-482e-bdd2-28d033a3e077-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:45 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff" returned: 0 in 0.947s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:45 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.214s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:45 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Deleted volume successfully. Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6a4f66-d098-4fc8-b10d-201c87005b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4aef43-36d3-4953-8b92-2f870ffbe771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Volume volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff (20160b3a-dae9-4e71-920c-50e85ad4a0ff): created successfully Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4aef43-36d3-4953-8b92-2f870ffbe771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Flow 'volume_create_manager' (9e235d64-8cbb-44e7-b1e4-b27aa94ad15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-616558ad-c23d-4549-90f1-12c5e41de48e tempest-VolumesTestJSON-2104203147 None] Lock "cinder-58cb9f72-7938-4087-89ac-8167ce7d4756-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:46 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8ca10746-10bc-4a61-801b-dfb323b19d67 tempest-AttachVolumeTestJSON-1369393165 None] Created volume successfully. Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d" returned: 0 in 1.222s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:46 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d Jul 01 06:51:46 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:46 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a" returned: 0 in 1.252s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:46 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a Jul 01 06:51:46 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:46 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f" returned: 0 in 1.122s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:46 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f Jul 01 06:51:46 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:46 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02411e9a-3cae-4f48-b521-5e6ab362561d" returned: 0 in 0.730s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-quobyte-02411e9a-3cae-4f48-b521-5e6ab362561d" released by "delete_volume" :: held 2.046s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:46 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-83c27ceb-d4a8-4d60-a783-f4d256ddc91a" returned: 0 in 0.695s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-quobyte-83c27ceb-d4a8-4d60-a783-f4d256ddc91a" released by "delete_volume" :: held 2.060s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Created reservations ['7b913344-9470-4fdb-8dbf-348a485317bd', '6c668357-e6f4-4105-b5d2-848616deed6d', '968432b8-0654-401b-8d2c-e7864b02d237', 'bee3c593-6028-40c2-85f1-83950ea5e2e1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:46 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Created reservations ['6c90837b-ca29-4e4d-8168-613e653106f0', '283827b4-997b-44ea-b32d-e6a2845cd1c8', '136ba63e-4061-40e0-bc19-411d05996b37', 'e0919464-8f26-44d7-a3b2-3a961e35d690'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:47 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-62a07b6f-be64-4ccc-b20e-f70f8af4879f" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:47 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:47 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-quobyte-62a07b6f-be64-4ccc-b20e-f70f8af4879f" released by "delete_volume" :: held 1.951s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:47 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:47 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Created reservations ['60b26a04-c0ed-41cf-a822-da639e5d4797', '4b2115d9-d674-44ba-af46-de296be4d420', '08cf0e04-91d7-4ba6-89e9-aa3021a7105f', 'a6fdeba3-4e41-4de7-8c6a-7c75915ff09a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:47 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:47 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:47 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.694s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Deleted volume successfully. Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a3998eb2-983a-44d9-8998-493058ff2872 tempest-VolumesSnapshotTestJSON-577538962 None] Lock "cinder-02411e9a-3cae-4f48-b521-5e6ab362561d-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:47 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.710s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Deleted volume successfully. Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-33993fe0-8648-4c28-928c-42bd35406267 tempest-VolumesListTestJSON-419662527 None] Lock "cinder-83c27ceb-d4a8-4d60-a783-f4d256ddc91a-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:47 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.676s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Deleted volume successfully. Jul 01 06:51:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-744ca86e-82f8-47f5-908a-6b7f8148a3a9 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-62a07b6f-be64-4ccc-b20e-f70f8af4879f-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "cinder-85500de1-3301-4e23-9979-21aa5591dc3f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-85500de1-3301-4e23-9979-21aa5591dc3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "cinder-quobyte-85500de1-3301-4e23-9979-21aa5591dc3f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:51:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-quobyte-85500de1-3301-4e23-9979-21aa5591dc3f" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:51:48 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6a859-c4a9-4009-86ff-3fa6b567a390]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:48 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f Jul 01 06:51:48 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:49 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f" returned: 0 in 0.926s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:49 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f Jul 01 06:51:49 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:49 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d6941-11f6-495d-8a26-e967b8bb0891]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:50 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff Jul 01 06:51:50 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:50 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-85500de1-3301-4e23-9979-21aa5591dc3f" returned: 0 in 0.845s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-quobyte-85500de1-3301-4e23-9979-21aa5591dc3f" released by "delete_volume" :: held 1.826s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Created reservations ['32e5d20d-9407-4e8f-a59c-0df582661d4a', '84b39859-6260-4a18-8752-8e6d17f81f6f', 'a416c493-0ae8-461f-8cce-332562a747e5', '1610bce8-df18-4a6d-a189-e3474b52dfbb'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:50 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:51:50 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:51 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff" returned: 0 in 1.187s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.207s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa100cd2-a54a-4b64-9ee1-e3add21e7e71', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:51:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-d6d4a0b6-5902-4a7d-a7e9-2b54e16a0e62 req-faf54441-5989-46e8-9f4a-95d787e23077 tempest-AttachVolumeTestJSON-1369393165 None] attachment_update completed successfully. Jul 01 06:51:51 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.953s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:51 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:51:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Deleted volume successfully. Jul 01 06:51:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3dd0900f-0f1c-4246-a83c-1e7e920a0bb8 tempest-VolumesTestJSON-2104203147 None] Lock "cinder-85500de1-3301-4e23-9979-21aa5591dc3f-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Flow 'volume_create_manager' (83ed7271-6229-474a-bbad-2e131649de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ad153e-acf9-4198-ba1b-8d009fc05005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ad153e-acf9-4198-ba1b-8d009fc05005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1513256483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebc473d-0963-476f-bdf6-4e50114e1230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249248368215452685815bd4e560bd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:53Z,use_quota=True,user_id='619e0189d09148b9acf9a9786cca5be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b983556-d7d6-4d16-9683-cdbb34e525eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b983556-d7d6-4d16-9683-cdbb34e525eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b229f5e6-b425-4923-a45f-4615dc1acf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b229f5e6-b425-4923-a45f-4615dc1acf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ebc473d-0963-476f-bdf6-4e50114e1230', 'volume_name': 'volume-9ebc473d-0963-476f-bdf6-4e50114e1230', 'volume_size': 2}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c871c77c-da5c-4897-9976-0176e97bff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c871c77c-da5c-4897-9976-0176e97bff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f78e7c2-2ed4-4811-bf4d-0c3e1469537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:52 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Volume 9ebc473d-0963-476f-bdf6-4e50114e1230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ebc473d-0963-476f-bdf6-4e50114e1230', 'volume_size': 2} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1513256483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebc473d-0963-476f-bdf6-4e50114e1230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249248368215452685815bd4e560bd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:53Z,use_quota=True,user_id='619e0189d09148b9acf9a9786cca5be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Creating volume 9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:52 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 2147483648 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:52 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 2147483648 Jul 01 06:51:52 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:53 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 2147483648" returned: 0 in 1.067s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:53 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 Jul 01 06:51:53 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:54 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230" returned: 0 in 0.646s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f78e7c2-2ed4-4811-bf4d-0c3e1469537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebc473d-0963-476f-bdf6-4e50114e1230', 'volume_size': 2}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b9b9cc-ee60-485c-b4ce-6655581cc061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:54 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Volume volume-9ebc473d-0963-476f-bdf6-4e50114e1230 (9ebc473d-0963-476f-bdf6-4e50114e1230): created successfully Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b9b9cc-ee60-485c-b4ce-6655581cc061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Flow 'volume_create_manager' (83ed7271-6229-474a-bbad-2e131649de1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-62ac4236-20da-4487-9f88-6ca604b3a122 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Created volume successfully. Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Flow 'volume_create_manager' (5e755487-4726-4acf-a915-2d3a0b652cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbb9924-9fc7-40fe-825d-b813acad1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbb9924-9fc7-40fe-825d-b813acad1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124344793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9e3536-70b4-4d42-9975-eb5cc96495d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d28ac761a64ed585ccf19e886c8a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:55Z,use_quota=True,user_id='e7b6b0d284eb46eeb648c9edd0ba4a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7382b2c9-3379-4c26-96c1-e595a49f323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7382b2c9-3379-4c26-96c1-e595a49f323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f881390f-7599-425b-af2f-0049c42d1082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f881390f-7599-425b-af2f-0049c42d1082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9e3536-70b4-4d42-9975-eb5cc96495d7', 'volume_name': 'volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632b6367-472a-471c-afc8-9b4c78810d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632b6367-472a-471c-afc8-9b4c78810d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af4d5f6-3b92-4211-b565-4d322224870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:55 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Volume cf9e3536-70b4-4d42-9975-eb5cc96495d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7', 'volume_size': 1} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-124344793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9e3536-70b4-4d42-9975-eb5cc96495d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d28ac761a64ed585ccf19e886c8a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:51:55Z,use_quota=True,user_id='e7b6b0d284eb46eeb648c9edd0ba4a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Creating volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:51:55 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:55 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 1073741824 Jul 01 06:51:55 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:56 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 1073741824" returned: 0 in 1.005s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:56 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 Jul 01 06:51:56 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:57 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7" returned: 0 in 0.672s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.424s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af4d5f6-3b92-4211-b565-4d322224870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d37032-4f30-4ac1-a6e6-dc5a65541d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Creating offline snapshot a1908a72-2fc3-4ded-870d-5536474b0bd1 of volume 9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:51:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Volume volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 (cf9e3536-70b4-4d42-9975-eb5cc96495d7): created successfully Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d37032-4f30-4ac1-a6e6-dc5a65541d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Flow 'volume_create_manager' (5e755487-4726-4acf-a915-2d3a0b652cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a28d19-525e-49c0-acaf-bc1f00048122]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:51:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3c7b6cdc-c912-4cd0-8745-7a15838a59fa tempest-VolumesSnapshotListTestJSON-939384294 None] Created volume successfully. Jul 01 06:51:57 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 Jul 01 06:51:57 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:51:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-dac49727-ae28-4aa4-b7fb-ac2feea343cd req-986c5228-8977-4983-9719-15b6b5efa37d tempest-AttachVolumeTestJSON-1369393165 None] Terminate volume connection completed successfully. Jul 01 06:51:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-dac49727-ae28-4aa4-b7fb-ac2feea343cd req-986c5228-8977-4983-9719-15b6b5efa37d tempest-AttachVolumeTestJSON-1369393165 None] Deleting attachment 90fda724-f644-454a-be80-633f58ea7aa8. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:51:58 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230" returned: 0 in 0.954s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 2G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:58 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 2G Jul 01 06:51:58 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:51:59 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 01 06:51:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 2G" returned: 0 in 0.974s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:51:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc473d-0963-476f-bdf6-4e50114e1230 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:51:59 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc473d-0963-476f-bdf6-4e50114e1230 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 Jul 01 06:51:59 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:00 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc473d-0963-476f-bdf6-4e50114e1230 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1" returned: 0 in 0.707s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:00 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 is being set with open permissions: ugo+rw Jul 01 06:52:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:00 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 Jul 01 06:52:00 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:00 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-b23a1dc2-4225-445f-917a-5fc48d95b179 req-2e5c3c1d-150f-41ba-88b4-f694cf87d057 tempest-AttachVolumeTestJSON-1369393165 None] Terminate volume connection completed successfully. Jul 01 06:52:00 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-b23a1dc2-4225-445f-917a-5fc48d95b179 req-2e5c3c1d-150f-41ba-88b4-f694cf87d057 tempest-AttachVolumeTestJSON-1369393165 None] Deleting attachment fa100cd2-a54a-4b64-9ee1-e3add21e7e71. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:52:00 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:00 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info Jul 01 06:52:00 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:01 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info" returned: 0 in 0.705s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:01 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info is being set with open permissions: ugo+rw Jul 01 06:52:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:01 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info Jul 01 06:52:01 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:02 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.info" returned: 0 in 0.670s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.833s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.111s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Creating offline snapshot e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 of volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:52:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[37459de5-616d-4a7e-b4fa-8bd0f6e2a8ed]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9507749f-9a20-459e-8d43-7ae738278dce tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Create snapshot completed successfully Jul 01 06:52:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:02 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 Jul 01 06:52:02 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:03 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7" returned: 0 in 0.852s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:03 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 1G Jul 01 06:52:03 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "cinder-a1908a72-2fc3-4ded-870d-5536474b0bd1-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-a1908a72-2fc3-4ded-870d-5536474b0bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "cinder-quobyte-9ebc473d-0963-476f-bdf6-4e50114e1230" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-quobyte-9ebc473d-0963-476f-bdf6-4e50114e1230" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "cinder-quobyte-a1908a72-2fc3-4ded-870d-5536474b0bd1" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-quobyte-a1908a72-2fc3-4ded-870d-5536474b0bd1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Deleting offline snapshot a1908a72-2fc3-4ded-870d-5536474b0bd1 of volume 9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] snapshot_file for this snap is: volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f5d183-d0eb-44c4-b127-96f27da089fa]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:03 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 Jul 01 06:52:03 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:04 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 1G" returned: 0 in 1.025s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:04 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:04 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:04 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1" returned: 0 in 1.155s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ebc473d-0963-476f-bdf6-4e50114e1230(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c6faf-87eb-4d1c-a66d-5509181c83fa]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:04 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 Jul 01 06:52:04 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:05 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 1.184s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:05 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 is being set with open permissions: ugo+rw Jul 01 06:52:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:05 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:05 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:05 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230" returned: 0 in 0.948s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:05 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 Jul 01 06:52:05 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:06 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 0.698s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:06 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info Jul 01 06:52:06 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:06 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1" returned: 0 in 1.084s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:06 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1 Jul 01 06:52:06 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:06 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info" returned: 0 in 0.831s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:06 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info is being set with open permissions: ugo+rw Jul 01 06:52:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:06 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info Jul 01 06:52:06 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:07 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230.a1908a72-2fc3-4ded-870d-5536474b0bd1" returned: 0 in 0.706s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-quobyte-a1908a72-2fc3-4ded-870d-5536474b0bd1" released by "_delete_snapshot" :: held 4.036s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-quobyte-9ebc473d-0963-476f-bdf6-4e50114e1230" released by "delete_snapshot" :: held 4.070s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:07 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.info" returned: 0 in 0.708s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.466s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Created reservations ['0339d317-c7b9-4206-b8c7-7750ef9dd26e', 'dc37b1f7-8aa0-499b-ac96-8686df9481a1', 'c9dd5b23-dc84-4e47-9818-82475a1d16e7', '7505164e-c2fd-4b93-8d96-9262221d504e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f92674f9-ae8a-4284-9727-5b4563b08b64 tempest-VolumesSnapshotListTestJSON-939384294 None] Create snapshot completed successfully Jul 01 06:52:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Delete snapshot completed successfully. Jul 01 06:52:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a5141f27-968a-442c-8105-fddffd86d396 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-a1908a72-2fc3-4ded-870d-5536474b0bd1-delete_snapshot" released by "delete_snapshot" :: held 4.278s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Creating offline snapshot 08e73a8a-682b-4398-bbe0-7b4456720403 of volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc23287e-2060-4fa4-b8d3-26d570546576]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "cinder-9ebc473d-0963-476f-bdf6-4e50114e1230-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-9ebc473d-0963-476f-bdf6-4e50114e1230-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "cinder-quobyte-9ebc473d-0963-476f-bdf6-4e50114e1230" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-quobyte-9ebc473d-0963-476f-bdf6-4e50114e1230" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:09 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:09 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8c617e-c78c-41d7-83e4-8eaaeca98066]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Flow 'volume_create_manager' (8be1b366-da51-426b-be20-0fcc84788551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5d67ba-f78a-457f-9bdf-777206025365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5d67ba-f78a-457f-9bdf-777206025365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2061550823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483d637ff95a443196e5cf009fcf6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:09Z,use_quota=True,user_id='232e3934777147a79abf5bd4c10d99a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87bcbd3a-5b05-4326-af66-78db88fec65d),volume_type_id=87bcbd3a-5b05-4326-af66-78db88fec65d)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d799da3-bae5-4f81-b1fd-b32b49347ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d799da3-bae5-4f81-b1fd-b32b49347ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ec1aed-6d8f-43f2-a60d-2a25708306ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ec1aed-6d8f-43f2-a60d-2a25708306ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949', 'volume_name': 'volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3b5ce8-c7c1-42fe-a36e-7fcb23c652a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3b5ce8-c7c1-42fe-a36e-7fcb23c652a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91633146-970c-4b7a-a5f3-f15dbb82b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Volume dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949', 'volume_size': 1} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:09 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 Jul 01 06:52:09 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:09 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 0.809s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:09 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 1G Jul 01 06:52:09 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:09 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230" returned: 0 in 0.793s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:09 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230 Jul 01 06:52:09 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:10 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 1G" returned: 0 in 0.824s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:10 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:10 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:10 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9ebc473d-0963-476f-bdf6-4e50114e1230" returned: 0 in 0.700s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-quobyte-9ebc473d-0963-476f-bdf6-4e50114e1230" released by "delete_volume" :: held 1.563s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Created reservations ['0f56c0b3-cdf7-4b91-8d7e-deb24898eb4e', '34b8a58a-cfe6-42da-858e-e82565268645', '5a20c40a-f863-4ab8-99ea-2ce28be1c490', '21324d90-cc10-42eb-bc27-ad8c4e59bfff'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:10 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:10 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:11 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 0.845s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:11 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 is being set with open permissions: ugo+rw Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:11 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:11 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:11 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.776s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:11 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Deleted volume successfully. Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-abd2eba6-c242-49ff-a8a7-60e121d3b675 tempest-VolumesSnapshotNegativeTestJSON-1381542189 None] Lock "cinder-9ebc473d-0963-476f-bdf6-4e50114e1230-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "cinder-20160b3a-dae9-4e71-920c-50e85ad4a0ff-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-20160b3a-dae9-4e71-920c-50e85ad4a0ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "cinder-quobyte-20160b3a-dae9-4e71-920c-50e85ad4a0ff" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-quobyte-20160b3a-dae9-4e71-920c-50e85ad4a0ff" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee44ebf-8b80-4cad-b393-bf23ceff0a99]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:11 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff Jul 01 06:52:11 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:12 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 0.861s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.494s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.093s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2061550823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483d637ff95a443196e5cf009fcf6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:09Z,use_quota=True,user_id='232e3934777147a79abf5bd4c10d99a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87bcbd3a-5b05-4326-af66-78db88fec65d),volume_type_id=87bcbd3a-5b05-4326-af66-78db88fec65d)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Creating volume dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:12 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:12 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 1073741824 Jul 01 06:52:12 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7ccacc97-8c47-4194-a112-de60776541c5 tempest-VolumesSnapshotListTestJSON-939384294 None] Create snapshot completed successfully Jul 01 06:52:12 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff" returned: 0 in 0.879s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:12 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff Jul 01 06:52:12 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:13 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 1073741824" returned: 0 in 0.999s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:13 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 Jul 01 06:52:13 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:13 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-20160b3a-dae9-4e71-920c-50e85ad4a0ff" returned: 0 in 0.786s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-quobyte-20160b3a-dae9-4e71-920c-50e85ad4a0ff" released by "delete_volume" :: held 1.714s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Created reservations ['1b4145f0-e9fc-4402-8fdf-82bfb29bc3f9', 'a0cc8667-52a5-4521-bcd7-91566a8e170b', '2f66f72a-48fd-462a-a8cf-72ae2f47cec5', 'cc02eaef-f8f8-4ec6-b89b-6a8a57acc082'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:13 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:13 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:13 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.826s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "cinder-8de73a17-09b7-4f88-9291-52ed4032ca10-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Creating offline snapshot 01d524e6-9b26-4ef0-b606-b10913028f6f of volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91633146-970c-4b7a-a5f3-f15dbb82b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0067d8cf-3f94-4bad-902a-37824499d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fa95f3-622f-4825-8ef0-8edc5b2f9771]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:14 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Volume volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 (dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949): created successfully Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0067d8cf-3f94-4bad-902a-37824499d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Flow 'volume_create_manager' (8be1b366-da51-426b-be20-0fcc84788551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-8de73a17-09b7-4f88-9291-52ed4032ca10-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-29302483-448f-4c3c-9e8a-285c52e15ebf tempest-VolumeTypesAccessTest-1447366961 None] Created volume successfully. Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "cinder-quobyte-8de73a17-09b7-4f88-9291-52ed4032ca10" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-quobyte-8de73a17-09b7-4f88-9291-52ed4032ca10" acquired by "delete_volume" :: waited 0.037s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:14 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:14 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5695c88-d26d-4b66-9c3c-9bb0495d30b7]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:14 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.765s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Deleted volume successfully. Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b1e80f3e-cc75-455a-be55-1ad3def6d6b2 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-20160b3a-dae9-4e71-920c-50e85ad4a0ff-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:14 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 Jul 01 06:52:14 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Acquiring lock "cinder-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Lock "cinder-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Acquiring lock "cinder-quobyte-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Lock "cinder-quobyte-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[959905b1-26f9-4e6c-977a-70a728e4055d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:14 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 Jul 01 06:52:14 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:15 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 1.224s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:15 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f 1G Jul 01 06:52:15 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:15 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10" returned: 0 in 1.074s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:15 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10 Jul 01 06:52:15 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:15 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949" returned: 0 in 1.070s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:15 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949 Jul 01 06:52:15 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:16 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8de73a17-09b7-4f88-9291-52ed4032ca10" returned: 0 in 0.888s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-quobyte-8de73a17-09b7-4f88-9291-52ed4032ca10" released by "delete_volume" :: held 2.058s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Created reservations ['c29fec4f-54aa-42ba-93de-c2cd286da4cc', '1fb81abd-6dca-446a-9834-7d52a20300bf', 'e36b490f-3e5d-46b7-ad16-4dead0835684', 'a5f2c195-d542-4675-83df-db5b1c1aa0fd'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:16 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f 1G" returned: 0 in 1.167s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:16 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f Jul 01 06:52:16 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:16 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949" returned: 0 in 0.775s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:16 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Lock "cinder-quobyte-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949" released by "delete_volume" :: held 1.912s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:16 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:16 devstack cinder-volume[86219]: WARNING cinder.quota [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-223529730 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-223529730, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:52:16 devstack cinder-volume[86219]: WARNING cinder.quota [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-223529730 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-223529730, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Created reservations ['1439960c-4acd-4c6d-aae3-fa7f0986edb0', '5670b779-5337-4733-b12e-f8ee135d6cb4', '54fbd835-be3e-448b-84a0-67a45a1badc3', '2fd6b81c-c886-4962-82f9-036ed92145b7'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:16 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:16 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:17 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.058s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Deleted volume successfully. Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "cinder-f060e32d-1806-4664-bc51-c34d293cc11d-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-f060e32d-1806-4664-bc51-c34d293cc11d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:17 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81251800-7ca9-4fe4-84e7-d3e921a4a03e tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-8de73a17-09b7-4f88-9291-52ed4032ca10-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=128,cinder:INSERT=38,cinder:UPDATE=157,cinder:DELETE=13 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f" returned: 0 in 1.179s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:17 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f is being set with open permissions: ugo+rw Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=121,cinder:UPDATE=154,cinder:DELETE=14,cinder:INSERT=35 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:52:17 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f Jul 01 06:52:17 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "cinder-quobyte-f060e32d-1806-4664-bc51-c34d293cc11d" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-quobyte-f060e32d-1806-4664-bc51-c34d293cc11d" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[24431f39-3d1a-4477-ae53-9cb96ae6c91a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:17 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.085s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Deleted volume successfully. Jul 01 06:52:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e2352f5e-11c7-4b53-9930-078bedf29ed2 tempest-VolumeTypesAccessTest-1447366961 None] Lock "cinder-dd062e62-d3c9-4aa3-8cbe-0b0b7d5af949-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:18 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d Jul 01 06:52:18 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:18 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f" returned: 0 in 1.059s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4fde4041-25e0-4aa7-8288-0a51cd1690d1 tempest-VolumesSnapshotListTestJSON-939384294 None] Create snapshot completed successfully Jul 01 06:52:18 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d" returned: 0 in 1.047s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:18 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d Jul 01 06:52:18 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:19 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f060e32d-1806-4664-bc51-c34d293cc11d" returned: 0 in 0.709s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-quobyte-f060e32d-1806-4664-bc51-c34d293cc11d" released by "delete_volume" :: held 1.816s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Created reservations ['e69a443e-8594-474e-9cd4-3d294f69e252', '93e84818-4fe5-43ee-b4e9-f3d63ada5ee6', '91a8d04f-3199-4c87-aa47-984d76f8bd97', 'fc18037d-5e8b-4dbb-9a2f-d9169c441e6e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:19 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:19 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-01d524e6-9b26-4ef0-b606-b10913028f6f-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-01d524e6-9b26-4ef0-b606-b10913028f6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-01d524e6-9b26-4ef0-b606-b10913028f6f" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-01d524e6-9b26-4ef0-b606-b10913028f6f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Deleting offline snapshot 01d524e6-9b26-4ef0-b606-b10913028f6f of volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] snapshot_file for this snap is: volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3395500-bc64-4e9d-8331-56453fe8eac8]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:20 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.974s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Deleted volume successfully. Jul 01 06:52:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6b8d0ec-11a3-4c94-a4c1-8c578e9c0058 tempest-AttachVolumeTestJSON-1369393165 None] Lock "cinder-f060e32d-1806-4664-bc51-c34d293cc11d-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:20 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f Jul 01 06:52:20 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:21 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f" returned: 0 in 1.016s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:21 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a826513-4118-4915-a361-a97303081825]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:21 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:21 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:22 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 0.884s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:22 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f Jul 01 06:52:22 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:23 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f" returned: 0 in 1.030s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:23 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f Jul 01 06:52:23 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:24 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.01d524e6-9b26-4ef0-b606-b10913028f6f" returned: 0 in 0.848s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-01d524e6-9b26-4ef0-b606-b10913028f6f" released by "_delete_snapshot" :: held 3.923s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" released by "delete_snapshot" :: held 3.955s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Created reservations ['a2e2d99f-79cd-4ae6-99fe-e7b1290ae0e7', '15e4633c-9f7f-489c-afaf-0a880055a403', 'a31fb57d-4bc3-4c5f-b86b-68ed95125993', '64226439-e557-421c-a347-9c5f10367190'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:24 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Delete snapshot completed successfully. Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-04c2761e-e0d2-4ae7-8481-d4815cf7e4e8 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-01d524e6-9b26-4ef0-b606-b10913028f6f-delete_snapshot" released by "delete_snapshot" :: held 4.166s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-08e73a8a-682b-4398-bbe0-7b4456720403-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-08e73a8a-682b-4398-bbe0-7b4456720403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-08e73a8a-682b-4398-bbe0-7b4456720403" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-08e73a8a-682b-4398-bbe0-7b4456720403" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Deleting offline snapshot 08e73a8a-682b-4398-bbe0-7b4456720403 of volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:52:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] snapshot_file for this snap is: volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:52:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1eca9-07d0-4d87-84b8-2547f7e064ed]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:25 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:25 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:26 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 1.044s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a84b17-570c-475e-aee6-53674a351b86]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:26 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:26 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:26 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:26 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:27 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.821s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:52:27 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 1.211s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:27 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:27 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:28 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 1.195s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:28 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403 Jul 01 06:52:28 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:29 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.08e73a8a-682b-4398-bbe0-7b4456720403" returned: 0 in 0.946s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-08e73a8a-682b-4398-bbe0-7b4456720403" released by "_delete_snapshot" :: held 4.520s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" released by "delete_snapshot" :: held 4.555s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Created reservations ['4d063a4f-c63d-4954-93ba-1bb61ed79796', 'b60ea58a-f7b1-4c27-9cc1-b1321758391d', '34a71200-d605-4634-8d0b-f89049480da9', '2f59860d-adfd-4608-a06b-2746e358f6e3'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Delete snapshot completed successfully. Jul 01 06:52:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-521f5ade-5614-44f6-841b-46da059e70b7 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-08e73a8a-682b-4398-bbe0-7b4456720403-delete_snapshot" released by "delete_snapshot" :: held 4.732s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Deleting offline snapshot e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 of volume cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] snapshot_file for this snap is: volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9892c79-f059-4d9e-a127-ce833b947236]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:30 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:30 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:31 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 1.041s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:52:31 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a00042-6c07-4e26-ba0c-3868244960d5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:32 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 Jul 01 06:52:32 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:32 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7" returned: 0 in 1.063s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:32 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:32 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:33 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 1.053s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:34 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6 Jul 01 06:52:34 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:34 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7.e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" returned: 0 in 0.722s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6" released by "_delete_snapshot" :: held 4.041s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" released by "delete_snapshot" :: held 4.078s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:34 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Created reservations ['b792a7e6-e07e-4607-bc35-05e8dd6ef6dc', '8c8723a0-8cf2-4267-bc08-8cbf39e45094', '87540124-8b5f-4d31-bf9f-15439f8d7348', '46b44909-539e-44f4-add4-62f43e94b4ef'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Delete snapshot completed successfully. Jul 01 06:52:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ce25661-b618-404d-bca9-b56550ca1da2 tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-e327c0ea-7263-4c0e-bfb1-17ff6ddfddc6-delete_snapshot" released by "delete_snapshot" :: held 4.275s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-cf9e3536-70b4-4d42-9975-eb5cc96495d7-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-cf9e3536-70b4-4d42-9975-eb5cc96495d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:36 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b0743e-a5d7-42b2-8a76-ad96c06a2800]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:36 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 Jul 01 06:52:36 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:37 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7" returned: 0 in 0.815s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:37 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7 Jul 01 06:52:37 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:37 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cf9e3536-70b4-4d42-9975-eb5cc96495d7" returned: 0 in 0.730s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-quobyte-cf9e3536-70b4-4d42-9975-eb5cc96495d7" released by "delete_volume" :: held 1.625s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Created reservations ['0c07a8e2-dac0-4ce7-a107-f076a37bf39e', 'f10e7e9d-ad18-47e6-8044-68026017d466', 'f7d31be6-a25e-4da0-8aa5-45b877afb223', '2099dc7f-cb25-4294-b638-1cbe6f03ec84'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:38 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:38 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:39 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.138s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:39 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:39 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Deleted volume successfully. Jul 01 06:52:39 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-679c3bdc-b40f-4166-85b8-8d53b05b3f4b tempest-VolumesSnapshotListTestJSON-939384294 None] Lock "cinder-cf9e3536-70b4-4d42-9975-eb5cc96495d7-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:43 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c6aec97a-f7fc-498d-91af-94d5b796da4e tempest-GroupsTest-418766440 None] Group tempest-Group1-1078506276: creating Jul 01 06:52:43 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c6aec97a-f7fc-498d-91af-94d5b796da4e tempest-GroupsTest-418766440 None] Group tempest-Group1-1078506276: created successfully Jul 01 06:52:43 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c6aec97a-f7fc-498d-91af-94d5b796da4e tempest-GroupsTest-418766440 None] Create group completed successfully. Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Flow 'volume_create_manager' (adee003c-ec0d-4610-a180-d492fdf1330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a597f52d-a194-426c-baa1-3bf94378c132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a597f52d-a194-426c-baa1-3bf94378c132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-821453971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b3ff1a-c453-4eb8-8d8f-c7b948656d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167f6b71c2e444a99847e182815d3196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:44Z,use_quota=True,user_id='4bea99bed6bf470288f7a49eda5a5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6b9777-0d26-46c2-af52-f2de4996825c),volume_type_id=7a6b9777-0d26-46c2-af52-f2de4996825c)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c518e2-ce1d-4b51-acea-b18f32e2f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c518e2-ce1d-4b51-acea-b18f32e2f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b865cfd-7426-408f-84e5-167485648764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b865cfd-7426-408f-84e5-167485648764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b3ff1a-c453-4eb8-8d8f-c7b948656d17', 'volume_name': 'volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc46b8f-b7d3-4d16-b739-f89f9644fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc46b8f-b7d3-4d16-b739-f89f9644fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1add9433-fb1f-44db-9895-2df2327874e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume 43b3ff1a-c453-4eb8-8d8f-c7b948656d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17', 'volume_size': 1} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-821453971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b3ff1a-c453-4eb8-8d8f-c7b948656d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167f6b71c2e444a99847e182815d3196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:44Z,use_quota=True,user_id='4bea99bed6bf470288f7a49eda5a5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6b9777-0d26-46c2-af52-f2de4996825c),volume_type_id=7a6b9777-0d26-46c2-af52-f2de4996825c)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Creating volume 43b3ff1a-c453-4eb8-8d8f-c7b948656d17 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:44 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:44 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 1073741824 Jul 01 06:52:44 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Flow 'volume_create_manager' (97f3f4c2-f83b-407d-be93-afcc1a0908b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc30ad7a-942f-4f06-87f9-43ac82715ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc30ad7a-942f-4f06-87f9-43ac82715ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1808171543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be81af8a-e572-4f69-ae1c-74a9f0df5927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167f6b71c2e444a99847e182815d3196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:45Z,use_quota=True,user_id='4bea99bed6bf470288f7a49eda5a5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23619b2-fe55-4a4a-8832-89a7731289cd),volume_type_id=a23619b2-fe55-4a4a-8832-89a7731289cd)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e944b8-b560-4e86-8851-30e61f330603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e944b8-b560-4e86-8851-30e61f330603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b095f154-ab06-4ed5-98e4-caf537302611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b095f154-ab06-4ed5-98e4-caf537302611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be81af8a-e572-4f69-ae1c-74a9f0df5927', 'volume_name': 'volume-be81af8a-e572-4f69-ae1c-74a9f0df5927', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eaba87-44c8-41b4-ae36-afe0c1ab07ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eaba87-44c8-41b4-ae36-afe0c1ab07ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135f76b0-4104-4708-8865-f0e33fdc2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume be81af8a-e572-4f69-ae1c-74a9f0df5927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be81af8a-e572-4f69-ae1c-74a9f0df5927', 'volume_size': 1} Jul 01 06:52:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:45 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 1073741824" returned: 0 in 1.364s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:45 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 Jul 01 06:52:45 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Flow 'volume_create_manager' (c472b4e8-8cef-4263-ab85-a18f8931f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937113d0-c720-41a2-be1a-a5accc5a82ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937113d0-c720-41a2-be1a-a5accc5a82ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-847149510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167f6b71c2e444a99847e182815d3196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:46Z,use_quota=True,user_id='4bea99bed6bf470288f7a49eda5a5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc55bcc4-99a5-4cb7-a3ff-1224f9c7e17b),volume_type_id=cc55bcc4-99a5-4cb7-a3ff-1224f9c7e17b)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b9d86c-193f-49d2-8a96-a076c508a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b9d86c-193f-49d2-8a96-a076c508a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a7b457-51cb-47c8-b4c3-28e0b4742be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:45 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 06:52:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-586eb0ee-2226-4ae6-a1f3-604e30155c3d tempest-GroupsTest-418766440 None] Group tempest-Group2-19978508: creating Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Flow 'volume_create_manager' (61502bb6-fa3f-4ab5-a4fe-44f09fe84ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fdb823-7ab6-41d2-8814-cc113b8af1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fdb823-7ab6-41d2-8814-cc113b8af1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1327872605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0a38c9-6550-44e4-a040-2cf50d72d686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5799c19c72cd441b983493af0ef11963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:46Z,use_quota=True,user_id='26ab1f580d214e7da0ec54342f1597af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65d4552-33d7-4a9a-832f-9afa3b73fce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65d4552-33d7-4a9a-832f-9afa3b73fce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24cf98c-309e-4636-993f-04409d8fa405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24cf98c-309e-4636-993f-04409d8fa405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0a38c9-6550-44e4-a040-2cf50d72d686', 'volume_name': 'volume-6a0a38c9-6550-44e4-a040-2cf50d72d686', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52aa700-aa4b-412c-bfc8-256f21fed0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52aa700-aa4b-412c-bfc8-256f21fed0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc3171-94ce-45bb-aa4f-75a04c629d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Volume 6a0a38c9-6550-44e4-a040-2cf50d72d686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0a38c9-6550-44e4-a040-2cf50d72d686', 'volume_size': 1} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-586eb0ee-2226-4ae6-a1f3-604e30155c3d tempest-GroupsTest-418766440 None] Group tempest-Group2-19978508: created successfully Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-586eb0ee-2226-4ae6-a1f3-604e30155c3d tempest-GroupsTest-418766440 None] Create group completed successfully. Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a7b457-51cb-47c8-b4c3-28e0b4742be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5', 'volume_name': 'volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5', 'volume_size': 1, 'image_id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74205bda-d4c6-4482-8f66-548f85daa25c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1669214033', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '167f6b71c2e444a99847e182815d3196', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'created_at': datetime.datetime(2026, 7, 1, 4, 52, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 52, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74205bda-d4c6-4482-8f66-548f85daa25c/file', 'properties': {}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6bf62c-a83e-45ef-a167-8a197c2abdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6bf62c-a83e-45ef-a167-8a197c2abdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fc49a7-1b62-4776-b8c0-37b6e5e15d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5', 'volume_size': 1, 'image_id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74205bda-d4c6-4482-8f66-548f85daa25c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1669214033', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '167f6b71c2e444a99847e182815d3196', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'created_at': datetime.datetime(2026, 7, 1, 4, 52, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 52, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74205bda-d4c6-4482-8f66-548f85daa25c/file', 'properties': {}}, 'image_service': } Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Trying to clone 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 from image 74205bda-d4c6-4482-8f66-548f85daa25c at location (None, [{'url': 'file:///opt/stack/data/glance/images/74205bda-d4c6-4482-8f66-548f85daa25c', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 06:52:46 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" returned: 0 in 0.778s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1808171543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be81af8a-e572-4f69-ae1c-74a9f0df5927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167f6b71c2e444a99847e182815d3196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:45Z,use_quota=True,user_id='4bea99bed6bf470288f7a49eda5a5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23619b2-fe55-4a4a-8832-89a7731289cd),volume_type_id=a23619b2-fe55-4a4a-8832-89a7731289cd)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Creating volume be81af8a-e572-4f69-ae1c-74a9f0df5927 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:46 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 1073741824 Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1add9433-fb1f-44db-9895-2df2327874e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de38b861-a2eb-453d-b81f-8b657c038a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 (43b3ff1a-c453-4eb8-8d8f-c7b948656d17): created successfully Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de38b861-a2eb-453d-b81f-8b657c038a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Flow 'volume_create_manager' (adee003c-ec0d-4610-a180-d492fdf1330c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5ef5ee39-97eb-4c79-9e6c-a423eed4f1e3 tempest-TestInstancesWithCinderVolumes-1206331780 None] Created volume successfully. Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Flow 'volume_create_manager' (f2c2f27f-b53b-4f24-8e8d-bdc067c290f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b75d1-2f0e-4e15-828a-f561f9c59c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b75d1-2f0e-4e15-828a-f561f9c59c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026713090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d797090e-b226-4b0f-8d77-9465fcd2e241,host='devstack@QuobyteHD#QuobyteHD',id=caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89698ce4e540eeab2e2fb0dfac6750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:47Z,use_quota=True,user_id='29bbc74f105645678f01a4f7ffe7f352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e92e7d4-c1ef-4263-8912-f692fc3db58c),volume_type_id=0e92e7d4-c1ef-4263-8912-f692fc3db58c)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c358be4-02d9-43ee-9fd7-ceed7089f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c358be4-02d9-43ee-9fd7-ceed7089f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb4f1fa-bf89-4bf9-aacf-7cbf95ea640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb4f1fa-bf89-4bf9-aacf-7cbf95ea640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04', 'volume_name': 'volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81991dc8-42f0-4b43-bbc3-d7262ed5419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:47 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81991dc8-42f0-4b43-bbc3-d7262ed5419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f5c54e-70ad-4ca5-bea9-7b4d5d24208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:47 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Volume caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04', 'volume_size': 1} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 1073741824" returned: 0 in 1.090s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:47 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 Jul 01 06:52:47 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:48 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927" returned: 0 in 0.710s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1327872605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0a38c9-6550-44e4-a040-2cf50d72d686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5799c19c72cd441b983493af0ef11963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:46Z,use_quota=True,user_id='26ab1f580d214e7da0ec54342f1597af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Creating volume 6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:48 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135f76b0-4104-4708-8865-f0e33fdc2a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be81af8a-e572-4f69-ae1c-74a9f0df5927', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:48 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 1073741824 Jul 01 06:52:48 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a86091-d27b-4cdd-b32c-70cfc951696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 (be81af8a-e572-4f69-ae1c-74a9f0df5927): created successfully Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a86091-d27b-4cdd-b32c-70cfc951696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Flow 'volume_create_manager' (97f3f4c2-f83b-407d-be93-afcc1a0908b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-947a60fa-9afa-43f1-a14a-b6c0958cbb94 tempest-TestInstancesWithCinderVolumes-1206331780 None] Created volume successfully. Jul 01 06:52:49 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 1073741824" returned: 0 in 1.069s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:49 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 Jul 01 06:52:49 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:50 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686" returned: 0 in 0.820s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.692s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d797090e-b226-4b0f-8d77-9465fcd2e241,created_at=2026-07-01T04:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026713090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d797090e-b226-4b0f-8d77-9465fcd2e241,host='devstack@QuobyteHD#QuobyteHD',id=caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89698ce4e540eeab2e2fb0dfac6750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:47Z,use_quota=True,user_id='29bbc74f105645678f01a4f7ffe7f352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e92e7d4-c1ef-4263-8912-f692fc3db58c),volume_type_id=0e92e7d4-c1ef-4263-8912-f692fc3db58c)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Creating volume caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:50 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:50 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 1073741824 Jul 01 06:52:50 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc3171-94ce-45bb-aa4f-75a04c629d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0a38c9-6550-44e4-a040-2cf50d72d686', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffe4493-0c89-4d89-925b-469fbc2d9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:50 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Volume volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 (6a0a38c9-6550-44e4-a040-2cf50d72d686): created successfully Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffe4493-0c89-4d89-925b-469fbc2d9815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Flow 'volume_create_manager' (61502bb6-fa3f-4ab5-a4fe-44f09fe84ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:50 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-062e98fe-ad7b-45b8-886a-ab8f51d09eae tempest-SnapshotMetadataTestJSON-1759281502 None] Created volume successfully. Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD, size 20.69 MB, duration 4.50 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 06:52:50 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Image download 20.69 MB at 4.60 MB/s Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe77d7-82cb-4236-b9eb-8fb5048ba975]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:51 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD Jul 01 06:52:51 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:51 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 1073741824" returned: 0 in 1.123s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:51 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 Jul 01 06:52:51 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:51 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD" returned: 0 in 1.058s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Temporary image 74205bda-d4c6-4482-8f66-548f85daa25c is fetched for user 4bea99bed6bf470288f7a49eda5a5cfe. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5c67db-66f2-40ea-bbcf-d3d165b82e4f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:52 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD Jul 01 06:52:52 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:52 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04" returned: 0 in 0.789s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.697s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f5c54e-70ad-4ca5-bea9-7b4d5d24208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d691f-a6b9-44fe-b637-d8badcfbdf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Creating offline snapshot 856a52c8-f688-4be3-8b8f-57008a64f381 of volume 6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:52:52 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Volume volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 (caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04): created successfully Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d691f-a6b9-44fe-b637-d8badcfbdf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Flow 'volume_create_manager' (f2c2f27f-b53b-4f24-8e8d-bdc067c290f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b754972-8e22-4a78-83be-f22bd8d8e856]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-55ef8349-954c-4dff-8711-2d2f9bcbba2e tempest-GroupsTest-418766440 None] Created volume successfully. Jul 01 06:52:52 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 Jul 01 06:52:52 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:53 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Acquiring lock "cinder-quobyte-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Lock "cinder-quobyte-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04" acquired by "delete_volume" :: waited 0.037s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1f441-805e-411d-bf7c-06b86f8c62ea]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:53 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686" returned: 0 in 1.356s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:53 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 1G Jul 01 06:52:53 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:53 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 Jul 01 06:52:53 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:54 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04" returned: 0 in 0.867s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:54 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04 Jul 01 06:52:54 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:54 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 1G" returned: 0 in 0.856s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:54 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 Jul 01 06:52:54 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:55 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04" returned: 0 in 0.796s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Lock "cinder-quobyte-caaa7a2c-d03e-47b5-a3f1-69fcf7c05f04" released by "delete_volume" :: held 1.769s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Created reservations ['99aa9a36-ccd6-49d7-a8d1-c6024db3cd2c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:55 devstack cinder-volume[86219]: WARNING cinder.quota [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-153656070 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-153656070, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:52:55 devstack cinder-volume[86219]: WARNING cinder.quota [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-153656070 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-153656070, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Created reservations ['51e63b88-43ce-4043-9c0b-9d3cb13baa8d', 'de4d9f5e-5217-4496-b986-0636c2807000', '26a8160a-4a6a-4de2-b887-2c988292efbd', '60158412-671c-484f-ab09-b30efb3d067f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:55 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381" returned: 0 in 0.887s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:55 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 is being set with open permissions: ugo+rw Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:55 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 Jul 01 06:52:55 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:55 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:55 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Created reservations ['54935f16-aa11-4acb-9bbc-f68ed5235df1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:56 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381" returned: 0 in 0.806s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:56 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:52:56 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:56 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info Jul 01 06:52:56 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:56 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.824s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-58ededb3-6dc6-441f-b335-91bab75fefdf tempest-GroupsTest-418766440 None] Delete group completed successfully. Jul 01 06:52:56 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.719s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:56 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:52:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-aa834d7b-ca49-4aa1-bba8-250f0e09b57e tempest-GroupsTest-418766440 None] Delete group completed successfully. Jul 01 06:52:57 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info" returned: 0 in 0.706s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:57 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info is being set with open permissions: ugo+rw Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:57 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info Jul 01 06:52:57 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:57 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.info" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.431s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.594s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-847149510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167f6b71c2e444a99847e182815d3196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:52:46Z,use_quota=True,user_id='4bea99bed6bf470288f7a49eda5a5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc55bcc4-99a5-4cb7-a3ff-1224f9c7e17b),volume_type_id=cc55bcc4-99a5-4cb7-a3ff-1224f9c7e17b)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Creating volume 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:57 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:57 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 1073741824 Jul 01 06:52:57 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d0cf9933-093b-44e6-99e7-949b690ac7c3 tempest-SnapshotMetadataTestJSON-1759281502 None] Create snapshot completed successfully Jul 01 06:52:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a987ce51-71db-4de7-8288-c27589fee00f tempest-GroupsTest-418766440 None] Group tempest-GroupsTest-Group-1065669393: creating Jul 01 06:52:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a987ce51-71db-4de7-8288-c27589fee00f tempest-GroupsTest-418766440 None] Group tempest-GroupsTest-Group-1065669393: created successfully Jul 01 06:52:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a987ce51-71db-4de7-8288-c27589fee00f tempest-GroupsTest-418766440 None] Create group completed successfully. Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "cinder-856a52c8-f688-4be3-8b8f-57008a64f381-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-856a52c8-f688-4be3-8b8f-57008a64f381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "cinder-quobyte-6a0a38c9-6550-44e4-a040-2cf50d72d686" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:58 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 1073741824" returned: 0 in 0.981s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-quobyte-6a0a38c9-6550-44e4-a040-2cf50d72d686" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "cinder-quobyte-856a52c8-f688-4be3-8b8f-57008a64f381" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-quobyte-856a52c8-f688-4be3-8b8f-57008a64f381" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:52:58 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Deleting offline snapshot 856a52c8-f688-4be3-8b8f-57008a64f381 of volume 6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:52:58 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] snapshot_file for this snap is: volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8eddc-c628-4276-90b7-85b2a8647d58]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:59 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 Jul 01 06:52:59 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:52:59 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 0 in 0.857s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Attempting download of 74205bda-d4c6-4482-8f66-548f85daa25c ((None, [{'url': 'file:///opt/stack/data/glance/images/74205bda-d4c6-4482-8f66-548f85daa25c', 'metadata': {}}])) to volume 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Flow 'volume_create_manager' (5558010a-8dfe-4cd2-a443-79bea14f1ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c1532e-a637-4b1d-b9ac-c2730e9d1bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c1532e-a637-4b1d-b9ac-c2730e9d1bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377782666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb47d43-7cc2-46fc-ad5f-8afe871e1a65,host='devstack@QuobyteHD#QuobyteHD',id=50b4e958-dfb7-41fb-a0ee-d65d76ee4d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89698ce4e540eeab2e2fb0dfac6750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:00Z,use_quota=True,user_id='29bbc74f105645678f01a4f7ffe7f352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e338b8f0-cd90-4fcb-8495-5d7137cb44a4),volume_type_id=e338b8f0-cd90-4fcb-8495-5d7137cb44a4)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e995321-b91e-4f2b-bd58-177afecfebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e995321-b91e-4f2b-bd58-177afecfebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa5298f-f9d9-48df-be59-110266138657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa5298f-f9d9-48df-be59-110266138657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b4e958-dfb7-41fb-a0ee-d65d76ee4d11', 'volume_name': 'volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4dcaf4-ddbc-4671-bb4b-a4784b50e142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4dcaf4-ddbc-4671-bb4b-a4784b50e142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90529a45-18a4-462c-9385-285a9a71ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:52:59 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Volume 50b4e958-dfb7-41fb-a0ee-d65d76ee4d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11', 'volume_size': 1} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4eb47d43-7cc2-46fc-ad5f-8afe871e1a65,created_at=2026-07-01T04:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377782666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb47d43-7cc2-46fc-ad5f-8afe871e1a65,host='devstack@QuobyteHD#QuobyteHD',id=50b4e958-dfb7-41fb-a0ee-d65d76ee4d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89698ce4e540eeab2e2fb0dfac6750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:00Z,use_quota=True,user_id='29bbc74f105645678f01a4f7ffe7f352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e338b8f0-cd90-4fcb-8495-5d7137cb44a4),volume_type_id=e338b8f0-cd90-4fcb-8495-5d7137cb44a4)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Creating volume 50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:52:59 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee3aeb4-0430-4081-952e-0fbae450a0c6]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:52:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:52:59 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 1073741824 Jul 01 06:52:59 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:00 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo Jul 01 06:53:00 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:00 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381" returned: 0 in 1.275s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a0a38c9-6550-44e4-a040-2cf50d72d686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:53:00 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7729ae-546a-4526-9396-fa35e29e0dc8]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:00 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 Jul 01 06:53:00 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:00 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo" returned: 0 in 0.820s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:01 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo Jul 01 06:53:01 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:01 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 1073741824" returned: 0 in 1.272s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:01 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 Jul 01 06:53:01 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:01 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686" returned: 0 in 1.182s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:01 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 Jul 01 06:53:01 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:01 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo" returned: 1 in 1.073s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74205bda-d4c6-4482-8f66-548f85daa25c_p8wccpmo' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8318d4-0a87-4a7a-80c7-8c496d56f017]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:01 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD Jul 01 06:53:01 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:02 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11" returned: 0 in 0.828s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90529a45-18a4-462c-9385-285a9a71ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ebd62f-813e-4f6d-8707-178986746d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:02 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Volume volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 (50b4e958-dfb7-41fb-a0ee-d65d76ee4d11): created successfully Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ebd62f-813e-4f6d-8707-178986746d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Flow 'volume_create_manager' (5558010a-8dfe-4cd2-a443-79bea14f1ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-be78bfcc-49f7-48aa-b683-699fbc0011bf tempest-GroupsTest-418766440 None] Created volume successfully. Jul 01 06:53:02 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381" returned: 0 in 1.094s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:02 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381 Jul 01 06:53:02 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:02 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] 74205bda-d4c6-4482-8f66-548f85daa25c was qcow2, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 06:53:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:02 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:53:02 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Flow 'volume_create_manager' (72ccd001-c350-4f18-b64f-63060193794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594fda7b-0b13-44ee-bea1-5d708219392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594fda7b-0b13-44ee-bea1-5d708219392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161680957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb47d43-7cc2-46fc-ad5f-8afe871e1a65,host='devstack@QuobyteHD#QuobyteHD',id=5d6a13dc-e394-4757-ac65-61135bc56797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89698ce4e540eeab2e2fb0dfac6750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:03Z,use_quota=True,user_id='29bbc74f105645678f01a4f7ffe7f352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e338b8f0-cd90-4fcb-8495-5d7137cb44a4),volume_type_id=e338b8f0-cd90-4fcb-8495-5d7137cb44a4)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76109897-bae3-4e27-b0be-8bd10aa8c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76109897-bae3-4e27-b0be-8bd10aa8c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a38599e-5946-458d-a173-795cb92ea5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a38599e-5946-458d-a173-795cb92ea5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6a13dc-e394-4757-ac65-61135bc56797', 'volume_name': 'volume-5d6a13dc-e394-4757-ac65-61135bc56797', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc18274e-ebad-4c31-9f39-e01051d096d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc18274e-ebad-4c31-9f39-e01051d096d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725953f1-c477-4b3d-88c0-e844ec151cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:03 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Volume 5d6a13dc-e394-4757-ac65-61135bc56797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6a13dc-e394-4757-ac65-61135bc56797', 'volume_size': 1} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4eb47d43-7cc2-46fc-ad5f-8afe871e1a65,created_at=2026-07-01T04:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161680957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb47d43-7cc2-46fc-ad5f-8afe871e1a65,host='devstack@QuobyteHD#QuobyteHD',id=5d6a13dc-e394-4757-ac65-61135bc56797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee89698ce4e540eeab2e2fb0dfac6750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:03Z,use_quota=True,user_id='29bbc74f105645678f01a4f7ffe7f352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e338b8f0-cd90-4fcb-8495-5d7137cb44a4),volume_type_id=e338b8f0-cd90-4fcb-8495-5d7137cb44a4)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Creating volume 5d6a13dc-e394-4757-ac65-61135bc56797 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:03 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:03 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 1073741824 Jul 01 06:53:03 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:03 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686.856a52c8-f688-4be3-8b8f-57008a64f381" returned: 0 in 0.936s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-quobyte-856a52c8-f688-4be3-8b8f-57008a64f381" released by "_delete_snapshot" :: held 4.658s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-quobyte-6a0a38c9-6550-44e4-a040-2cf50d72d686" released by "delete_snapshot" :: held 4.717s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Created reservations ['3bb9b5a9-dd28-467c-8ef0-954edb040b44', '3a06db9e-b3ea-453c-840e-8379be0d84f2', 'b21cfa56-2a65-40a2-a4fc-6bc09f4a485a', '6d689520-6cf1-412f-a36d-56649d6b9847'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Delete snapshot completed successfully. Jul 01 06:53:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d40a87d4-a459-42e4-9ddf-dcf7bacb3928 tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-856a52c8-f688-4be3-8b8f-57008a64f381-delete_snapshot" released by "delete_snapshot" :: held 4.990s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "cinder-6a0a38c9-6550-44e4-a040-2cf50d72d686-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-6a0a38c9-6550-44e4-a040-2cf50d72d686-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "cinder-quobyte-6a0a38c9-6550-44e4-a040-2cf50d72d686" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-quobyte-6a0a38c9-6550-44e4-a040-2cf50d72d686" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd3bc5-a858-461a-a8d7-335ac679e4db]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:04 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 1073741824" returned: 0 in 1.402s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:04 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 Jul 01 06:53:04 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:04 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 Jul 01 06:53:04 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:05 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797" returned: 0 in 0.732s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725953f1-c477-4b3d-88c0-e844ec151cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6a13dc-e394-4757-ac65-61135bc56797', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c38526d-b221-402a-83e1-338c064324a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:05 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Volume volume-5d6a13dc-e394-4757-ac65-61135bc56797 (5d6a13dc-e394-4757-ac65-61135bc56797): created successfully Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c38526d-b221-402a-83e1-338c064324a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Flow 'volume_create_manager' (72ccd001-c350-4f18-b64f-63060193794c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:05 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-10715581-b2b1-434b-9328-8e35842f9e50 tempest-GroupsTest-418766440 None] Created volume successfully. Jul 01 06:53:05 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 0 in 2.672s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74205bda-d4c6-4482-8f66-548f85daa25c_g5osgmqgdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:53:05 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Converted 112.00 MB image at 41.90 MB/s Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:05 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 1G Jul 01 06:53:05 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:05 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686" returned: 0 in 1.047s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:05 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686 Jul 01 06:53:05 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:06 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 1G" returned: 0 in 0.815s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:06 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6a0a38c9-6550-44e4-a040-2cf50d72d686" returned: 0 in 0.762s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-quobyte-6a0a38c9-6550-44e4-a040-2cf50d72d686" released by "delete_volume" :: held 1.894s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f0f79-be74-4b83-bde4-84e9fef0fb4b]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Created reservations ['743aed23-c1a0-4863-8b1e-546c01f88c23', '187024ee-a241-4856-b464-3419c3f8e73c', '4924229e-bec2-44cb-9866-71932bf4d324', '0c42f018-4d99-4a84-91fb-419170468070'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:06 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:53:06 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:06 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:53:06 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d4163d8e-b6f2-4c89-a3d9-750eb048cb8a tempest-GroupsTest-418766440 None] Update group completed successfully. Jul 01 06:53:07 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 0 in 0.972s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:07 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.857s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:07 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:53:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Deleted volume successfully. Jul 01 06:53:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4dd5b2f3-face-43a1-a4b2-17870d07698b tempest-SnapshotMetadataTestJSON-1759281502 None] Lock "cinder-6a0a38c9-6550-44e4-a040-2cf50d72d686-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:07 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:53:07 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:08 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-22c9de7a-ed7a-48ad-846e-78531d9bbc96 tempest-GroupsTest-418766440 None] Update group completed successfully. Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 1 in 1.215s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Downloaded image 74205bda-d4c6-4482-8f66-548f85daa25c ((None, [{'url': 'file:///opt/stack/data/glance/images/74205bda-d4c6-4482-8f66-548f85daa25c', 'metadata': {}}])) to volume 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Temporary image 74205bda-d4c6-4482-8f66-548f85daa25c for user 4bea99bed6bf470288f7a49eda5a5cfe is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Marking volume 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Copying metadata from image 74205bda-d4c6-4482-8f66-548f85daa25c to 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Creating volume glance metadata for volume 8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 backed by image 74205bda-d4c6-4482-8f66-548f85daa25c with: {'image_id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'image_name': 'tempest-scenario-img--1669214033', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fc49a7-1b62-4776-b8c0-37b6e5e15d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5', 'volume_size': 1, 'image_id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74205bda-d4c6-4482-8f66-548f85daa25c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1669214033', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '167f6b71c2e444a99847e182815d3196', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74205bda-d4c6-4482-8f66-548f85daa25c', 'created_at': datetime.datetime(2026, 7, 1, 4, 52, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 52, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74205bda-d4c6-4482-8f66-548f85daa25c/file', 'properties': {}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a64ee7e-1b5b-4140-920d-d08f9f42a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:08 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Volume volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 (8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5): created successfully Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a64ee7e-1b5b-4140-920d-d08f9f42a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Flow 'volume_create_manager' (c472b4e8-8cef-4263-ab85-a18f8931f83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d76e3e71-52c0-4cc4-bb7a-34afce0ba809 tempest-TestInstancesWithCinderVolumes-1206331780 None] Created volume successfully. Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Acquiring lock "cinder-quobyte-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Lock "cinder-quobyte-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[42481f72-4b35-4255-92a5-e03190b8048b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:10 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 Jul 01 06:53:10 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Flow 'volume_create_manager' (fb6204a3-2a40-4bcd-a12c-bb7ab92cecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80ee243-5844-461b-89ff-bfbf5669b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80ee243-5844-461b-89ff-bfbf5669b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-510036092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7384c82-ee32-4932-ac72-2f055eab095e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484a42660ca643d384966a7eb72b2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:11Z,use_quota=True,user_id='cbbae596afcc42feb721f0338a09022b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7762a1c3-f7b6-40fe-b096-cc2dad254e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7762a1c3-f7b6-40fe-b096-cc2dad254e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa50b08-e98f-4e47-b005-a8944ac6d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa50b08-e98f-4e47-b005-a8944ac6d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7384c82-ee32-4932-ac72-2f055eab095e', 'volume_name': 'volume-d7384c82-ee32-4932-ac72-2f055eab095e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40f93c2-ccd4-4967-b3fd-adfb61173ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40f93c2-ccd4-4967-b3fd-adfb61173ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9579abb-fc00-4d6d-ab96-8447771eefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:11 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Volume d7384c82-ee32-4932-ac72-2f055eab095e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7384c82-ee32-4932-ac72-2f055eab095e', 'volume_size': 1} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-510036092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7384c82-ee32-4932-ac72-2f055eab095e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484a42660ca643d384966a7eb72b2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:11Z,use_quota=True,user_id='cbbae596afcc42feb721f0338a09022b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Creating volume d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:11 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:11 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e 1073741824 Jul 01 06:53:11 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:11 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11" returned: 0 in 1.044s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:11 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11 Jul 01 06:53:11 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:12 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e 1073741824" returned: 0 in 1.040s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:12 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e Jul 01 06:53:12 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:12 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11" returned: 0 in 0.859s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Lock "cinder-quobyte-50b4e958-dfb7-41fb-a0ee-d65d76ee4d11" released by "delete_volume" :: held 1.968s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Acquiring lock "cinder-quobyte-5d6a13dc-e394-4757-ac65-61135bc56797" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Lock "cinder-quobyte-5d6a13dc-e394-4757-ac65-61135bc56797" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80408bc-f314-49df-8b5a-ed83a2555263]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:12 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 Jul 01 06:53:12 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:12 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e" returned: 0 in 0.789s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9579abb-fc00-4d6d-ab96-8447771eefe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7384c82-ee32-4932-ac72-2f055eab095e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfee5bee-7013-40d8-8411-9592ff1e2390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Volume volume-d7384c82-ee32-4932-ac72-2f055eab095e (d7384c82-ee32-4932-ac72-2f055eab095e): created successfully Jul 01 06:53:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfee5bee-7013-40d8-8411-9592ff1e2390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Flow 'volume_create_manager' (fb6204a3-2a40-4bcd-a12c-bb7ab92cecae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-75d10717-282d-4372-bd8f-575d4a36d7f2 tempest-VolumesDeleteCascade-1132888739 None] Created volume successfully. Jul 01 06:53:13 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797" returned: 0 in 0.825s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:13 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797 Jul 01 06:53:13 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:13 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5d6a13dc-e394-4757-ac65-61135bc56797" returned: 0 in 0.703s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Lock "cinder-quobyte-5d6a13dc-e394-4757-ac65-61135bc56797" released by "delete_volume" :: held 1.571s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Created reservations ['06d3d5da-833c-4aed-8413-b3a87b289c17'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:14 devstack cinder-volume[86219]: WARNING cinder.quota [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-722215440 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-722215440, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:53:14 devstack cinder-volume[86219]: WARNING cinder.quota [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-722215440 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-722215440, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Created reservations ['adcf8102-efeb-4b3d-a76f-04b63252cf00', '4591454e-6d99-47a8-a148-96de9ee27275', 'fe3b3d9c-76ee-4f34-9811-753665297fb3', 'b34d3302-5591-46cd-a329-87277ede760d'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Created reservations ['ff8c6f77-807b-40db-a313-06ea34b26856', '198ea991-ab4d-44ce-b06f-a5ef87becc00', 'e1d9536f-07cd-4f96-a1b4-cfd3a43d3481', 'c3822085-e18b-4e5c-9300-17a7be98c979'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Creating offline snapshot 6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd of volume d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1e8c0-0784-4bd2-ab2d-6a13937f6758]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:14 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:53:14 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:14 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e Jul 01 06:53:14 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:15 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.716s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:15 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:53:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-81bb2ab1-7d2c-4c1e-be09-4508864592c8 tempest-GroupsTest-418766440 None] Delete group completed successfully. Jul 01 06:53:15 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e" returned: 0 in 0.820s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:15 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd 1G Jul 01 06:53:15 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:15 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd 1G" returned: 0 in 0.853s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7384c82-ee32-4932-ac72-2f055eab095e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:16 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7384c82-ee32-4932-ac72-2f055eab095e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:16 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:16 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7384c82-ee32-4932-ac72-2f055eab095e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 0.907s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:16 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd is being set with open permissions: ugo+rw Jul 01 06:53:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:16 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:16 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:17 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 0.834s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:DELETE=8,cinder:SELECT=97,cinder:INSERT=32,cinder:UPDATE=113 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:53:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=104,cinder:UPDATE=109,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:53:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:17 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info Jul 01 06:53:17 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:18 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info" returned: 0 in 0.877s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:18 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info is being set with open permissions: ugo+rw Jul 01 06:53:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:18 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info Jul 01 06:53:18 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:19 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.info" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.258s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.667s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-18f4e350-97f2-4d68-8795-a21e8fa63002 tempest-VolumesDeleteCascade-1132888739 None] Create snapshot completed successfully Jul 01 06:53:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b3a48-ab0f-419b-93de-a73e2aeb0e2a]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:19 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:53:19 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:20 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 0 in 1.119s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:21 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:53:21 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:21 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 1 in 1.129s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.298s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.799s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Creating offline snapshot 39dbe7e4-052d-4201-b425-5205cab8cb93 of volume d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '827775c2-9f3c-42d2-8e9c-fcd5714ac112', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c573ff9-cb5e-4777-b9b2-c0896b441e03]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-37c44234-7241-4d10-9474-4f67bb528263 req-503e8553-d009-4740-b4d1-ad54969f7ddf tempest-TestInstancesWithCinderVolumes-1206331780 None] attachment_update completed successfully. Jul 01 06:53:22 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:22 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:22 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 0.943s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7384c82-ee32-4932-ac72-2f055eab095e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:53:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:22 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 1G Jul 01 06:53:22 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:23 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 1G" returned: 0 in 1.021s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:23 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 Jul 01 06:53:23 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:24 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93" returned: 0 in 0.842s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:24 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 is being set with open permissions: ugo+rw Jul 01 06:53:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:24 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 Jul 01 06:53:24 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:25 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93" returned: 0 in 0.744s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.716s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:25 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2bf2f152-4e39-4377-99e5-f2a4f60c8428 tempest-VolumesDeleteCascade-1132888739 None] Create snapshot completed successfully Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-d7384c82-ee32-4932-ac72-2f055eab095e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-d7384c82-ee32-4932-ac72-2f055eab095e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Performing cascade delete. {{(pid=86219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-39dbe7e4-052d-4201-b425-5205cab8cb93-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-39dbe7e4-052d-4201-b425-5205cab8cb93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:26 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:53:26 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-39dbe7e4-052d-4201-b425-5205cab8cb93" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-39dbe7e4-052d-4201-b425-5205cab8cb93" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Deleting offline snapshot 39dbe7e4-052d-4201-b425-5205cab8cb93 of volume d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] snapshot_file for this snap is: volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ad7790-807f-4f7d-9a36-9c2a694f0871]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:26 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 Jul 01 06:53:26 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:28 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 2.094s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:28 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:53:28 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:53:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:53:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:53:29 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93" returned: 0 in 2.477s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7384c82-ee32-4932-ac72-2f055eab095e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:53:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86eb3e-efdd-4c96-b2ad-f7dc28c3931f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:29 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:29 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:31 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 2.395s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7384c82-ee32-4932-ac72-2f055eab095e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:53:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:31 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 Jul 01 06:53:31 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:34 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93" returned: 0 in 2.470s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:34 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93 Jul 01 06:53:34 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Flow 'volume_create_manager' (e219da35-2295-4356-a1a2-d2f98573d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68af8c86-643c-41d4-9d36-dca40d2cbb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68af8c86-643c-41d4-9d36-dca40d2cbb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1443585528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c7f714-0e44-45da-a4e7-b665b742aa35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f2dca58a864ff7ac13a393414652f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:34Z,use_quota=True,user_id='f4e6c4a0b1d64e3e88c2690d7e9f70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a110c0-95fa-48c0-be70-54bb5694ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a110c0-95fa-48c0-be70-54bb5694ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3df0487-08ce-4adb-b7cb-8a468b8c3c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3df0487-08ce-4adb-b7cb-8a468b8c3c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c7f714-0e44-45da-a4e7-b665b742aa35', 'volume_name': 'volume-32c7f714-0e44-45da-a4e7-b665b742aa35', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a386f4-a679-4d10-a37a-d50ada254121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a386f4-a679-4d10-a37a-d50ada254121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7b52cc-a71b-4174-bde0-f340d277e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:34 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Volume 32c7f714-0e44-45da-a4e7-b665b742aa35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c7f714-0e44-45da-a4e7-b665b742aa35', 'volume_size': 1} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1443585528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c7f714-0e44-45da-a4e7-b665b742aa35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f2dca58a864ff7ac13a393414652f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:34Z,use_quota=True,user_id='f4e6c4a0b1d64e3e88c2690d7e9f70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Creating volume 32c7f714-0e44-45da-a4e7-b665b742aa35 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:34 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:53:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:34 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 1073741824 Jul 01 06:53:34 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:35 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.39dbe7e4-052d-4201-b425-5205cab8cb93" returned: 0 in 1.929s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-39dbe7e4-052d-4201-b425-5205cab8cb93" released by "_delete_snapshot" :: held 9.478s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" released by "delete_snapshot" :: held 9.518s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Created reservations ['d4018bc8-9d6e-4c6e-ad25-e8a6c951e1d4', '0b0826b4-3318-4673-9cf3-3a303da615a6', '26d9ad91-00b0-40b0-9dc7-8fabb8e02abd', 'fb25b665-d7d5-424f-8d57-1f3974944511'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Delete snapshot completed successfully. Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-39dbe7e4-052d-4201-b425-5205cab8cb93-delete_snapshot" released by "delete_snapshot" :: held 10.008s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:36 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 1073741824" returned: 0 in 2.215s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" acquired by "_delete_snapshot" :: waited 0.078s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Deleting offline snapshot 6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd of volume d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] snapshot_file for this snap is: volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[789df2be-edbc-455c-bc06-5b67d3d5750a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:36 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 Jul 01 06:53:36 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:37 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:37 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:38 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 1.379s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7384c82-ee32-4932-ac72-2f055eab095e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:53:38 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35" returned: 0 in 1.491s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] <== create_volume: return (3975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.978s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[433066a7-c983-4188-96cd-1137e7acdfba]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7b52cc-a71b-4174-bde0-f340d277e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c7f714-0e44-45da-a4e7-b665b742aa35', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ca17d3-78b5-4291-8ef5-f94b5948dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:38 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Volume volume-32c7f714-0e44-45da-a4e7-b665b742aa35 (32c7f714-0e44-45da-a4e7-b665b742aa35): created successfully Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ca17d3-78b5-4291-8ef5-f94b5948dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Flow 'volume_create_manager' (e219da35-2295-4356-a1a2-d2f98573d567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:38 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b235a6f7-dbf2-4234-b5e2-f0e640095547 tempest-VolumeQuotasAdminTestJSON-302972224 None] Created volume successfully. Jul 01 06:53:38 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e Jul 01 06:53:38 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "cinder-32c7f714-0e44-45da-a4e7-b665b742aa35-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "cinder-32c7f714-0e44-45da-a4e7-b665b742aa35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:40 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e" returned: 0 in 1.763s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "cinder-quobyte-32c7f714-0e44-45da-a4e7-b665b742aa35" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "cinder-quobyte-32c7f714-0e44-45da-a4e7-b665b742aa35" acquired by "delete_volume" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:40 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:40 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7b2cca-1608-4613-98b3-d4ab2a46b069]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:40 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 Jul 01 06:53:40 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:41 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35" returned: 0 in 1.406s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:41 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35 Jul 01 06:53:41 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:42 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 1.997s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:42 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd Jul 01 06:53:42 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:42 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-32c7f714-0e44-45da-a4e7-b665b742aa35" returned: 0 in 1.076s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "cinder-quobyte-32c7f714-0e44-45da-a4e7-b665b742aa35" released by "delete_volume" :: held 2.596s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:42 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Created reservations ['e42ab3fb-a433-480e-b16e-b0b4f2bd3c48', '886bd643-e699-4835-b945-61b6e8a65169', '987273c8-36aa-4126-85fa-d3f1d84e1ef5', 'bd601c73-6afe-4dff-9547-02648cecddf4'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:43 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:53:43 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:43 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e.6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" returned: 0 in 1.393s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd" released by "_delete_snapshot" :: held 6.850s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" released by "delete_snapshot" :: held 6.958s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:43 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Created reservations ['c562a479-988b-4dcd-9208-54606c68433d', '6f506086-1c61-4c3f-bd32-7960e3128f12', '99f0eb4a-3208-42f6-b483-449bf6285e4d', '0d53614f-f4b7-46ba-9dd2-7706d8ceb735'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Delete snapshot completed successfully. Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-6b25ef98-2cb7-45c6-a84a-d1b8921d6ecd-delete_snapshot" released by "delete_snapshot" :: held 7.528s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Snapshots deleted, issuing volume delete {{(pid=86219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[71441445-fd35-44f8-967c-155ab73b24e5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:44 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e Jul 01 06:53:44 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:44 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.526s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:53:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Deleted volume successfully. Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-90fadcff-5dd7-44b7-9a2f-1c600f7fce5f tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "cinder-32c7f714-0e44-45da-a4e7-b665b742aa35-delete_volume" released by "delete_volume" :: held 4.644s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Flow 'volume_create_manager' (12b68a6c-94b0-40dc-a1d5-3c694e5b0c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246bb3aa-2288-4662-8d94-783582b292cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246bb3aa-2288-4662-8d94-783582b292cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1055670971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d87c7f6-b318-4e09-a74a-4a4f30678d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f2dca58a864ff7ac13a393414652f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:45Z,use_quota=True,user_id='f4e6c4a0b1d64e3e88c2690d7e9f70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcd3fb0-a6e1-4182-94df-855545b0d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcd3fb0-a6e1-4182-94df-855545b0d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329beba9-0fa1-4684-ae1c-0567fe2760c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329beba9-0fa1-4684-ae1c-0567fe2760c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d87c7f6-b318-4e09-a74a-4a4f30678d96', 'volume_name': 'volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112f620-f936-459a-adc1-ee5ec9170ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112f620-f936-459a-adc1-ee5ec9170ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e7286f-99fe-4297-bed6-0248d3967db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:45 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Volume 0d87c7f6-b318-4e09-a74a-4a4f30678d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96', 'volume_size': 1} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1055670971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d87c7f6-b318-4e09-a74a-4a4f30678d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f2dca58a864ff7ac13a393414652f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:45Z,use_quota=True,user_id='f4e6c4a0b1d64e3e88c2690d7e9f70fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Creating volume 0d87c7f6-b318-4e09-a74a-4a4f30678d96 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:45 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:45 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 1073741824 Jul 01 06:53:45 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:45 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e" returned: 0 in 1.093s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:45 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e Jul 01 06:53:45 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:46 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-d7384c82-ee32-4932-ac72-2f055eab095e" returned: 0 in 0.785s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-d7384c82-ee32-4932-ac72-2f055eab095e" released by "delete_volume" :: held 1.966s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:46 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 1073741824" returned: 0 in 0.964s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Created reservations ['8cb30f11-41cb-4537-9db1-90742dd1c90d', '6e57f84f-cc01-4534-94d4-4ba0f301d6c1', '8c74cf53-6a57-4045-9ffb-83e8058bdf7e', '5c70008d-5abe-4c15-924f-433b210cb42e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:46 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 Jul 01 06:53:46 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:46 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:53:46 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:46 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e7286f-99fe-4297-bed6-0248d3967db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8aac60-df75-46d4-84cf-fad189323abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Volume volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 (0d87c7f6-b318-4e09-a74a-4a4f30678d96): created successfully Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8aac60-df75-46d4-84cf-fad189323abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Flow 'volume_create_manager' (12b68a6c-94b0-40dc-a1d5-3c694e5b0c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2be35b10-c09f-49bf-8c58-b3e4e46c1474 tempest-VolumeQuotasAdminTestJSON-302972224 None] Created volume successfully. Jul 01 06:53:46 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.740s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:53:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Deleted volume successfully. Jul 01 06:53:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3e8cd0a5-1d54-405d-92be-88402d752a43 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-d7384c82-ee32-4932-ac72-2f055eab095e-delete_volume" released by "delete_volume" :: held 20.611s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-243faf3d-b3c1-4ec6-a705-c35bd7dfc7eb tempest-VolumeQuotasAdminTestJSON-318260353 None] Transfer volume completed successfully. Jul 01 06:53:47 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Flow 'volume_create_manager' (549aa6a0-2b37-4ec1-9a08-d5415ad62c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e021ddf6-50e1-431b-998d-1b84c893a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e021ddf6-50e1-431b-998d-1b84c893a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-89016101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac99a04c-e783-4922-91c2-cede27102bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484a42660ca643d384966a7eb72b2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:48Z,use_quota=True,user_id='cbbae596afcc42feb721f0338a09022b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96257044-e220-4280-9f5b-3a910f652ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96257044-e220-4280-9f5b-3a910f652ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04850350-aeff-400b-b406-30e539337d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04850350-aeff-400b-b406-30e539337d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac99a04c-e783-4922-91c2-cede27102bf5', 'volume_name': 'volume-ac99a04c-e783-4922-91c2-cede27102bf5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca97ef9-f0ef-41e7-800d-74f7357dfda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca97ef9-f0ef-41e7-800d-74f7357dfda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1613651-4421-4118-857e-45ea87ede264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Volume ac99a04c-e783-4922-91c2-cede27102bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac99a04c-e783-4922-91c2-cede27102bf5', 'volume_size': 1} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-89016101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac99a04c-e783-4922-91c2-cede27102bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484a42660ca643d384966a7eb72b2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:48Z,use_quota=True,user_id='cbbae596afcc42feb721f0338a09022b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Creating volume ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:48 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:48 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 1073741824 Jul 01 06:53:48 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Acquiring lock "cinder-0d87c7f6-b318-4e09-a74a-4a4f30678d96-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Lock "cinder-0d87c7f6-b318-4e09-a74a-4a4f30678d96-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Acquiring lock "cinder-quobyte-0d87c7f6-b318-4e09-a74a-4a4f30678d96" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Lock "cinder-quobyte-0d87c7f6-b318-4e09-a74a-4a4f30678d96" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bb206-43dd-4e40-95eb-4152d33ffa2d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:49 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 Jul 01 06:53:49 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:49 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 1073741824" returned: 0 in 1.026s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:49 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:53:49 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:49 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:49 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96 Jul 01 06:53:49 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:49 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 0.671s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1613651-4421-4118-857e-45ea87ede264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac99a04c-e783-4922-91c2-cede27102bf5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8fb109-c911-40f4-b565-6c0627d30673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:49 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Volume volume-ac99a04c-e783-4922-91c2-cede27102bf5 (ac99a04c-e783-4922-91c2-cede27102bf5): created successfully Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8fb109-c911-40f4-b565-6c0627d30673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:49 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Flow 'volume_create_manager' (549aa6a0-2b37-4ec1-9a08-d5415ad62c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:49 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f3eca8cf-8ad8-410e-a196-a6bc65cfd756 tempest-VolumesDeleteCascade-1132888739 None] Created volume successfully. Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Creating offline snapshot b0c1d7a2-a3d1-4423-a403-9469b159c840 of volume ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f101cbc-e477-4952-b6ae-6a0998390cca]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:50 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:53:50 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:50 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d87c7f6-b318-4e09-a74a-4a4f30678d96" returned: 0 in 0.652s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Lock "cinder-quobyte-0d87c7f6-b318-4e09-a74a-4a4f30678d96" released by "delete_volume" :: held 1.494s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Created reservations ['8bb41577-afe2-4d1d-bbe8-899b2433e6db', 'b9946ba0-3ee4-402a-8be6-b6eb79f64b6e', 'f49dfece-c690-4740-867b-796bfebd95a4', '1ba83dcf-66bc-4968-ae4d-dfa7d35f1b6e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:50 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:53:50 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:51 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 0.888s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:51 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 1G Jul 01 06:53:51 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:51 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.990s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:51 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:53:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Deleted volume successfully. Jul 01 06:53:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f6476a2f-8e8c-41a1-89e6-ed047b4f2c8a tempest-VolumeQuotasAdminTestJSON-1616484034 None] Lock "cinder-0d87c7f6-b318-4e09-a74a-4a4f30678d96-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:53:52 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 1G" returned: 0 in 1.140s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac99a04c-e783-4922-91c2-cede27102bf5 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:52 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac99a04c-e783-4922-91c2-cede27102bf5 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 Jul 01 06:53:52 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:53 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac99a04c-e783-4922-91c2-cede27102bf5 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840" returned: 0 in 0.928s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:53 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 is being set with open permissions: ugo+rw Jul 01 06:53:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:53 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 Jul 01 06:53:53 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:53 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840" returned: 0 in 0.676s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:53 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info Jul 01 06:53:53 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:54 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info" returned: 0 in 0.833s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:54 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info is being set with open permissions: ugo+rw Jul 01 06:53:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:54 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info Jul 01 06:53:54 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:55 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.info" returned: 0 in 0.973s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.546s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Flow 'volume_create_manager' (1d63acba-aea5-4b01-aeb9-9f953eb5dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708ca2bb-c37f-4797-b0ad-07d0c01b08d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708ca2bb-c37f-4797-b0ad-07d0c01b08d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-38472823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d1c5e5-57f7-448e-9fd9-84c0856038a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ced50525944283ab54275c67d653f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:56Z,use_quota=True,user_id='3d67b74d6d884d1cabd54a9beb02d5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b09f0a-d5eb-41a5-8b90-528149aef06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b09f0a-d5eb-41a5-8b90-528149aef06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7285dd7e-30f4-4e8a-a3b0-394564f996fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7285dd7e-30f4-4e8a-a3b0-394564f996fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d1c5e5-57f7-448e-9fd9-84c0856038a9', 'volume_name': 'volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9be9c-fc5e-40b1-9e71-eb0596724a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9be9c-fc5e-40b1-9e71-eb0596724a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecd7d70-a17d-49ac-bd1a-c25c2aee70ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:55 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Volume f3d1c5e5-57f7-448e-9fd9-84c0856038a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9', 'volume_size': 1} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-38472823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d1c5e5-57f7-448e-9fd9-84c0856038a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ced50525944283ab54275c67d653f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:56Z,use_quota=True,user_id='3d67b74d6d884d1cabd54a9beb02d5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Creating volume f3d1c5e5-57f7-448e-9fd9-84c0856038a9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:55 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:53:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:55 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 1073741824 Jul 01 06:53:55 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7410243e-81a0-47fc-86b6-a7eb5591c339 tempest-VolumesDeleteCascade-1132888739 None] Create snapshot completed successfully Jul 01 06:53:56 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 1073741824" returned: 0 in 1.078s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:57 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 Jul 01 06:53:57 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Flow 'volume_create_manager' (d261c264-dfc1-4947-955c-56ea490c73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c194f1b-91e4-42c0-8939-edbe89f8ca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c194f1b-91e4-42c0-8939-edbe89f8ca43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-112874309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535d64b7-de72-4a60-b637-0783290ee815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484a42660ca643d384966a7eb72b2bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0c1d7a2-a3d1-4423-a403-9469b159c840,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:53:57Z,use_quota=True,user_id='cbbae596afcc42feb721f0338a09022b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cdb301-3c70-4b7e-967a-112c19fdfcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cdb301-3c70-4b7e-967a-112c19fdfcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990bb95f-8267-46c6-a66b-6060200607ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990bb95f-8267-46c6-a66b-6060200607ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '535d64b7-de72-4a60-b637-0783290ee815', 'volume_name': 'volume-535d64b7-de72-4a60-b637-0783290ee815', 'volume_size': 1, 'snapshot_id': 'b0c1d7a2-a3d1-4423-a403-9469b159c840'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2499b274-e836-49c4-83a3-70b364ff5b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2499b274-e836-49c4-83a3-70b364ff5b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc3682c-71ae-4faa-b083-a0dc659bf16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Volume 535d64b7-de72-4a60-b637-0783290ee815: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-535d64b7-de72-4a60-b637-0783290ee815', 'volume_size': 1, 'snapshot_id': 'b0c1d7a2-a3d1-4423-a403-9469b159c840'} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:57 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" returned: 0 in 0.803s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.283s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-b0c1d7a2-a3d1-4423-a403-9469b159c840-535d64b7-de72-4a60-b637-0783290ee815" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-b0c1d7a2-a3d1-4423-a403-9469b159c840-535d64b7-de72-4a60-b637-0783290ee815" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Creating volume 535d64b7-de72-4a60-b637-0783290ee815 from snapshot b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-535d64b7-de72-4a60-b637-0783290ee815" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecd7d70-a17d-49ac-bd1a-c25c2aee70ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27077c66-8a7f-4b7d-aa39-a4c28172e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-535d64b7-de72-4a60-b637-0783290ee815" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] snapshot: b0c1d7a2-a3d1-4423-a403-9469b159c840, volume: 535d64b7-de72-4a60-b637-0783290ee815, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:53:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Volume volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 (f3d1c5e5-57f7-448e-9fd9-84c0856038a9): created successfully Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27077c66-8a7f-4b7d-aa39-a4c28172e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Flow 'volume_create_manager' (1d63acba-aea5-4b01-aeb9-9f953eb5dc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:53:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5aa6222b-3c2f-44ef-97d9-18269b4bcb08 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Created volume successfully. Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec1eed-e8e9-4a4f-9f3e-d42f30f19cd3]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:58 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 Jul 01 06:53:58 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:58 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840" returned: 0 in 0.802s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac99a04c-e783-4922-91c2-cede27102bf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:53:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:53:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:53:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[92745e84-723b-4b5c-8d72-7f94e5c1cf5c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:53:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:58 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:53:58 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:59 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 0.837s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:53:59 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 Jul 01 06:53:59 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Flow 'volume_create_manager' (5fc5b78e-5ea4-43dd-b8fb-ed73b6dab9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b94407b-17d3-494f-8b70-5db60b044d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b94407b-17d3-494f-8b70-5db60b044d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1446003148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eda0859-79b5-4e15-b491-4b144d96d91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b602ed9e5ca4423885f510ac2a7fdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:00Z,use_quota=True,user_id='f10d4e6ef0d14886b6d9706aeefb2bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c08a48-08ff-470f-bae2-05787962252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c08a48-08ff-470f-bae2-05787962252a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2cc0c2-fa33-41fa-8bc7-f3072ff831b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2cc0c2-fa33-41fa-8bc7-f3072ff831b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eda0859-79b5-4e15-b491-4b144d96d91a', 'volume_name': 'volume-6eda0859-79b5-4e15-b491-4b144d96d91a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e1dd90-99e0-4c59-ae2d-d6079239de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e1dd90-99e0-4c59-ae2d-d6079239de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3152b9-13aa-4358-a162-eaa47c0b7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:53:59 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Volume 6eda0859-79b5-4e15-b491-4b144d96d91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eda0859-79b5-4e15-b491-4b144d96d91a', 'volume_size': 1} Jul 01 06:53:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:04 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815" returned: 0 in 4.972s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[133db0b5-b45f-4a3f-bb18-ff7b0c51004b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:04 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:54:04 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:05 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 0.903s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:05 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:54:05 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Converted 1024.00 MB image at 205.79 MB/s Jul 01 06:54:05 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 is being set with open permissions: ugo+rw Jul 01 06:54:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:05 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 Jul 01 06:54:05 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:06 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815" returned: 0 in 0.650s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-535d64b7-de72-4a60-b637-0783290ee815" released by "_copy_volume_from_snapshot" :: held 8.295s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-b0c1d7a2-a3d1-4423-a403-9469b159c840-535d64b7-de72-4a60-b637-0783290ee815" released by "_create_volume_from_snapshot" :: held 8.343s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.370s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.218s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1446003148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eda0859-79b5-4e15-b491-4b144d96d91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b602ed9e5ca4423885f510ac2a7fdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:00Z,use_quota=True,user_id='f10d4e6ef0d14886b6d9706aeefb2bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Creating volume 6eda0859-79b5-4e15-b491-4b144d96d91a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:06 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:06 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a 1073741824 Jul 01 06:54:06 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc3682c-71ae-4faa-b083-a0dc659bf16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535d64b7-de72-4a60-b637-0783290ee815', 'volume_size': 1, 'snapshot_id': 'b0c1d7a2-a3d1-4423-a403-9469b159c840'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d54bd-3770-4582-b3da-bcd0fabe837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:06 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Volume volume-535d64b7-de72-4a60-b637-0783290ee815 (535d64b7-de72-4a60-b637-0783290ee815): created successfully Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d54bd-3770-4582-b3da-bcd0fabe837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Flow 'volume_create_manager' (d261c264-dfc1-4947-955c-56ea490c73c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-712c7fb1-1da4-4ad6-8719-3f4f576442a8 tempest-VolumesDeleteCascade-1132888739 None] Created volume successfully. Jul 01 06:54:06 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a 1073741824" returned: 0 in 0.818s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:07 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a Jul 01 06:54:07 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:07 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a" returned: 0 in 0.630s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.165s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3152b9-13aa-4358-a162-eaa47c0b7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eda0859-79b5-4e15-b491-4b144d96d91a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d14523-6516-44d5-b148-6bd89ef500a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8a526-4eac-419a-bc0a-17eea463f1bb]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Volume volume-6eda0859-79b5-4e15-b491-4b144d96d91a (6eda0859-79b5-4e15-b491-4b144d96d91a): created successfully Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d14523-6516-44d5-b148-6bd89ef500a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Flow 'volume_create_manager' (5fc5b78e-5ea4-43dd-b8fb-ed73b6dab9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f34e2d3b-9953-4c77-9170-9f5d490e9dc2 tempest-VolumesServicesTestJSON-627071974 None] Created volume successfully. Jul 01 06:54:07 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 Jul 01 06:54:07 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:08 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" returned: 0 in 0.747s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.777s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.207s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ac84ed-1031-436f-b761-4b63cfd7d66c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3d35973-33d0-434d-b1c3-54154391dddc', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:54:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-0425d6c0-8ae5-4888-baee-1fb2584142e5 req-3b4c706a-9ba4-4e42-a084-6a53eb3c64d5 tempest-TestInstancesWithCinderVolumes-1206331780 None] attachment_update completed successfully. Jul 01 06:54:08 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 Jul 01 06:54:08 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:09 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" returned: 0 in 0.789s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ab3543-a4b7-42b1-986a-19a26fd2be80', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:54:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-dc85f665-7f10-429b-a1e6-1988090ddad9 req-e27ef4b4-25a9-4ad1-9202-5ce1b5dd1652 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] attachment_update completed successfully. Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-ac99a04c-e783-4922-91c2-cede27102bf5-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-ac99a04c-e783-4922-91c2-cede27102bf5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Performing cascade delete. {{(pid=86219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-b0c1d7a2-a3d1-4423-a403-9469b159c840-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-b0c1d7a2-a3d1-4423-a403-9469b159c840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-ac99a04c-e783-4922-91c2-cede27102bf5" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-ac99a04c-e783-4922-91c2-cede27102bf5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-b0c1d7a2-a3d1-4423-a403-9469b159c840" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-b0c1d7a2-a3d1-4423-a403-9469b159c840" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Deleting offline snapshot b0c1d7a2-a3d1-4423-a403-9469b159c840 of volume ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] snapshot_file for this snap is: volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa30896-4dc7-44ec-ae0c-c48921fc5e74]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Acquiring lock "cinder-6eda0859-79b5-4e15-b491-4b144d96d91a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Lock "cinder-6eda0859-79b5-4e15-b491-4b144d96d91a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Acquiring lock "cinder-quobyte-6eda0859-79b5-4e15-b491-4b144d96d91a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Lock "cinder-quobyte-6eda0859-79b5-4e15-b491-4b144d96d91a" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1185214-d189-4f99-a083-3cc34185949a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:09 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 Jul 01 06:54:09 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:09 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a Jul 01 06:54:09 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:10 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840" returned: 0 in 0.941s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac99a04c-e783-4922-91c2-cede27102bf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:54:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d8298-ed90-4e83-aabe-2514b9bab75d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:10 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a" returned: 0 in 0.887s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:10 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a Jul 01 06:54:10 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:10 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:54:10 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:11 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6eda0859-79b5-4e15-b491-4b144d96d91a" returned: 0 in 0.681s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Lock "cinder-quobyte-6eda0859-79b5-4e15-b491-4b144d96d91a" released by "delete_volume" :: held 1.624s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Created reservations ['407381e7-860a-4826-aee3-7248e7afefd5', '215379ed-8388-4005-9581-de2e98adf3d5', 'a430da9c-ea24-4121-b37d-d7c4907335d1', '71d43d33-25dd-4fd6-bee8-ff58c1460f7c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:11 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 0.836s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:11 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 Jul 01 06:54:11 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:11 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:11 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:12 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.666s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Deleted volume successfully. Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-74733c9c-4743-44da-8e69-013128071d04 tempest-VolumesServicesTestJSON-627071974 None] Lock "cinder-6eda0859-79b5-4e15-b491-4b144d96d91a-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:12 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840" returned: 0 in 0.805s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:12 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840 Jul 01 06:54:12 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:12 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5.b0c1d7a2-a3d1-4423-a403-9469b159c840" returned: 0 in 0.681s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-b0c1d7a2-a3d1-4423-a403-9469b159c840" released by "_delete_snapshot" :: held 3.394s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-ac99a04c-e783-4922-91c2-cede27102bf5" released by "delete_snapshot" :: held 3.424s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:12 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Created reservations ['6fefc402-94ee-4217-aa42-b2f28f276427', '8dbae142-ea4d-4c1d-a259-505651d2da65', 'd5bfd5be-330e-4743-9067-b999f70f1325', 'a191fe2d-c4a4-45fb-a39e-6644ef4b38f5'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Delete snapshot completed successfully. Jul 01 06:54:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-b0c1d7a2-a3d1-4423-a403-9469b159c840-delete_snapshot" released by "delete_snapshot" :: held 3.602s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:13 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Snapshots deleted, issuing volume delete {{(pid=86219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 01 06:54:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-ac99a04c-e783-4922-91c2-cede27102bf5" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-ac99a04c-e783-4922-91c2-cede27102bf5" acquired by "delete_volume" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce63069-af43-4b9f-b184-e513129add3a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:13 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:54:13 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:14 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 1.017s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:14 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5 Jul 01 06:54:14 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:14 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ac99a04c-e783-4922-91c2-cede27102bf5" returned: 0 in 0.788s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-ac99a04c-e783-4922-91c2-cede27102bf5" released by "delete_volume" :: held 1.881s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Created reservations ['1152a3b3-e67a-4267-92f5-c666e612cdd5', 'bd2b3fb8-e6fd-474d-982e-ed01144ab216', '5baeae1a-a654-4133-8ee2-c6e4bfa55032', '42a7f78c-ea35-41bb-a713-95349ce164da'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:15 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:15 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:15 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Deleted volume successfully. Jul 01 06:54:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4b20c1fb-67de-4021-8198-418a46ada142 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-ac99a04c-e783-4922-91c2-cede27102bf5-delete_volume" released by "delete_volume" :: held 6.461s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-535d64b7-de72-4a60-b637-0783290ee815-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-535d64b7-de72-4a60-b637-0783290ee815-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "cinder-quobyte-535d64b7-de72-4a60-b637-0783290ee815" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-535d64b7-de72-4a60-b637-0783290ee815" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[962108fa-f769-4308-be72-4a087781e68a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:16 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 Jul 01 06:54:16 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-af689a38-ca86-4d25-96f2-3aa87961af7d req-43f0a3d4-d44f-4fd9-9f19-21f2ba8b324c tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Terminate volume connection completed successfully. Jul 01 06:54:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-af689a38-ca86-4d25-96f2-3aa87961af7d req-43f0a3d4-d44f-4fd9-9f19-21f2ba8b324c tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Deleting attachment 32ab3543-a4b7-42b1-986a-19a26fd2be80. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:54:17 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815" returned: 0 in 0.888s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:17 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815 Jul 01 06:54:17 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[25958f8c-074b-4c24-9530-abb8354da94b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:17 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 Jul 01 06:54:17 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:17 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-535d64b7-de72-4a60-b637-0783290ee815" returned: 0 in 0.707s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-quobyte-535d64b7-de72-4a60-b637-0783290ee815" released by "delete_volume" :: held 1.650s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=84,cinder:SELECT=78,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=82,cinder:DELETE=8,cinder:UPDATE=79,cinder:INSERT=18 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:54:17 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Created reservations ['6f9f5ab7-06e3-4226-ab08-3f62e46ff938', '57894e22-672c-4627-b428-0c91126193e2', 'acf63756-f570-4634-b695-2f4cb398f725', '8bace31e-a6e4-4d41-a0ba-2777f9436f93'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:18 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:18 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:18 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927" returned: 0 in 0.862s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-be81af8a-e572-4f69-ae1c-74a9f0df5927', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faeb96fe-d19b-493a-9c9d-69d1661b6e95', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:54:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-15d2bec3-bc36-48aa-8969-69e98f2b95eb req-42aa9eb2-ed49-4fed-9a56-9eb6af770716 tempest-TestInstancesWithCinderVolumes-1206331780 None] attachment_update completed successfully. Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Acquiring lock "cinder-f3d1c5e5-57f7-448e-9fd9-84c0856038a9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "cinder-f3d1c5e5-57f7-448e-9fd9-84c0856038a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Acquiring lock "cinder-quobyte-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "cinder-quobyte-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" acquired by "delete_volume" :: waited 0.049s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[db80224f-c5bb-4693-a002-074427570cc3]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:18 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.880s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:18 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:18 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 Jul 01 06:54:18 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Deleted volume successfully. Jul 01 06:54:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1832a8dd-54fa-4ec9-b96b-6daa1a313c20 tempest-VolumesDeleteCascade-1132888739 None] Lock "cinder-535d64b7-de72-4a60-b637-0783290ee815-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:19 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" returned: 0 in 1.026s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:19 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9 Jul 01 06:54:19 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:20 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" returned: 0 in 0.788s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "cinder-quobyte-f3d1c5e5-57f7-448e-9fd9-84c0856038a9" released by "delete_volume" :: held 1.890s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Created reservations ['c18e2a96-b75f-451e-b771-f278e51eb378', '4334501a-d01d-4cf2-a598-6305728794ab', '3fc92ed2-4fdf-4fdf-8932-4ba45680206a', '5cd4b66b-e962-4ad8-939c-d638bf56dac8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:20 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:20 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:21 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.897s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:21 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Deleted volume successfully. Jul 01 06:54:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e3de762f-b402-4139-94f1-01cd0dd88706 tempest-TestServerVolumeAttachScenarioOldVersion-712396875 None] Lock "cinder-f3d1c5e5-57f7-448e-9fd9-84c0856038a9-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Flow 'volume_create_manager' (b2685228-d346-483b-acc2-aa1370e6aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94446d7c-b249-483c-941e-24db02e50bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94446d7c-b249-483c-941e-24db02e50bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1370176386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b55f67a-1832-47ff-8ddd-cc736ef0b4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5546e8ca1f48e8bb7d0177d9882dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:25Z,use_quota=True,user_id='310869be27aa427daea6e6846e22a738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47059777-6c48-4b14-880c-a7be6779acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47059777-6c48-4b14-880c-a7be6779acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8557770-658a-4dff-ab76-13e7f696f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8557770-658a-4dff-ab76-13e7f696f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b55f67a-1832-47ff-8ddd-cc736ef0b4fc', 'volume_name': 'volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace12fcd-b704-41ad-a8ce-ccb6bcddeb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace12fcd-b704-41ad-a8ce-ccb6bcddeb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429f52f5-b68b-4a7b-8f70-6b33c6bce03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:25 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Volume 9b55f67a-1832-47ff-8ddd-cc736ef0b4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc', 'volume_size': 1} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1370176386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b55f67a-1832-47ff-8ddd-cc736ef0b4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5546e8ca1f48e8bb7d0177d9882dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:25Z,use_quota=True,user_id='310869be27aa427daea6e6846e22a738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Creating volume 9b55f67a-1832-47ff-8ddd-cc736ef0b4fc {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:25 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:25 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc 1073741824 Jul 01 06:54:25 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:26 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc 1073741824" returned: 0 in 0.993s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:26 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc Jul 01 06:54:26 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:26 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:26 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:27 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc" returned: 0 in 0.780s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429f52f5-b68b-4a7b-8f70-6b33c6bce03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16798ab-6948-4322-bc12-69b0c3cfe6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:27 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Volume volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc (9b55f67a-1832-47ff-8ddd-cc736ef0b4fc): created successfully Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16798ab-6948-4322-bc12-69b0c3cfe6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Flow 'volume_create_manager' (b2685228-d346-483b-acc2-aa1370e6aca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:27 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2c171d00-7c90-41b7-9889-78a9e50d5122 tempest-VolumesTransfersV355Test-776938484 None] Created volume successfully. Jul 01 06:54:27 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.833s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Flow 'volume_create_manager' (b2baca34-23c7-4991-a29a-37634f2835e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40ebefb-7ae2-41c0-b655-065b2d67bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40ebefb-7ae2-41c0-b655-065b2d67bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2124551310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a74395ba1d4b19b353e88bd9586030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:27Z,use_quota=True,user_id='6667e848cc1a43c48a33c0fd64a9fad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a48e8-2ce3-4f89-a49e-5e9a00b8c58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a48e8-2ce3-4f89-a49e-5e9a00b8c58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1b26be-45b0-4e3c-9b8c-5fc9cda5df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1b26be-45b0-4e3c-9b8c-5fc9cda5df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9', 'volume_name': 'volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99fac63-5d25-4815-a40f-50d33b427fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99fac63-5d25-4815-a40f-50d33b427fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6110d320-d02b-47ed-b545-a4a401387792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:27 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Volume 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Trying to clone 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 06:54:27 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 06:54:27 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Image download 20.69 MB at 20.69 MB/s Jul 01 06:54:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0635b9c-2970-4291-95da-5d98b11ada4e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:28 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD Jul 01 06:54:28 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:28 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-f8467019-706b-4632-abe8-9f3dbf2c020c req-c1e77285-6f3a-4930-8fcd-2439e9cf770d tempest-TestInstancesWithCinderVolumes-1206331780 None] Terminate volume connection completed successfully. Jul 01 06:54:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-f8467019-706b-4632-abe8-9f3dbf2c020c req-c1e77285-6f3a-4930-8fcd-2439e9cf770d tempest-TestInstancesWithCinderVolumes-1206331780 None] Deleting attachment a3d35973-33d0-434d-b1c3-54154391dddc. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:54:28 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:28 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 is fetched for user 6667e848cc1a43c48a33c0fd64a9fad1. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 06:54:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c0fbb453-4cd1-41a8-a029-6589c06eca67 tempest-VolumesTransfersV355Test-487168641 None] Transfer volume completed successfully. Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdafa25c-c197-4623-8302-4a88f68a135a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:29 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD Jul 01 06:54:29 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:29 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2124551310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a74395ba1d4b19b353e88bd9586030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:27Z,use_quota=True,user_id='6667e848cc1a43c48a33c0fd64a9fad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Creating volume 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:29 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:29 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 1073741824 Jul 01 06:54:29 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Acquiring lock "cinder-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Acquiring lock "cinder-quobyte-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-quobyte-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc" acquired by "delete_volume" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36940e7-655c-416a-981d-38ce06b5dd21]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "cinder-43b3ff1a-c453-4eb8-8d8f-c7b948656d17-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-43b3ff1a-c453-4eb8-8d8f-c7b948656d17-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "cinder-quobyte-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-quobyte-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:30 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc Jul 01 06:54:30 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[277e57b5-2dee-4b6b-b043-1c756bd0ad9f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:30 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 Jul 01 06:54:30 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:31 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 1073741824" returned: 0 in 1.364s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:31 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:31 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:31 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc" returned: 0 in 1.088s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:31 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc Jul 01 06:54:31 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:31 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" returned: 0 in 1.229s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:31 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17 Jul 01 06:54:31 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:32 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 0 in 0.908s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Attempting download of 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e043d-5c74-4011-a29e-42c7b05880ca]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:32 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc" returned: 0 in 0.909s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-quobyte-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc" released by "delete_volume" :: held 2.068s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Created reservations ['9c0c7b9b-8585-42b7-b464-eca999b855f0', '951fc5bd-c3e5-4ed2-8a10-6cbbfd153adb', 'a4404dc9-f8b4-479f-a8dc-95a9f093d21f', 'd28bd826-4392-46f3-9356-ab8afb241d88'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:32 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44 Jul 01 06:54:32 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:32 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:32 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:32 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" returned: 0 in 0.959s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-quobyte-43b3ff1a-c453-4eb8-8d8f-c7b948656d17" released by "delete_volume" :: held 2.276s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:32 devstack cinder-volume[86219]: WARNING cinder.quota [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834598669-27425654 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834598669-27425654, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:54:32 devstack cinder-volume[86219]: WARNING cinder.quota [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834598669-27425654 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1834598669-27425654, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Created reservations ['121f72fc-80cf-4c11-8909-74e476e43cbf', 'b81c7167-98bf-4677-83f8-159188557174', '8b430a95-b565-48d7-a0a3-4ba11b3d5815', 'f8e6c1b9-4c0b-426c-a9a7-b3915515eeec'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:32 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:32 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:33 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44" returned: 0 in 1.075s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:33 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.926s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:33 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Deleted volume successfully. Jul 01 06:54:33 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44 Jul 01 06:54:33 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-150883f3-f6ef-4ec1-9bdb-053b12cf3943 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-9b55f67a-1832-47ff-8ddd-cc736ef0b4fc-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:34 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.270s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deleted volume successfully. Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8118be5d-1104-4723-95af-31bfed9adb91 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-43b3ff1a-c453-4eb8-8d8f-c7b948656d17-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:34 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44" returned: 1 in 1.133s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_ubu8ap44' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[237d3649-13da-4a07-b413-67549f5a591e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Flow 'volume_create_manager' (ad326e64-714e-4798-9e03-14eeb26deaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2a6bb1-d3a6-411a-b63c-e26bc291aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:34 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD Jul 01 06:54:34 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2a6bb1-d3a6-411a-b63c-e26bc291aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-149568662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b09a40-c4be-49ce-8642-04adf21f84e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5546e8ca1f48e8bb7d0177d9882dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:34Z,use_quota=True,user_id='310869be27aa427daea6e6846e22a738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fda8e79-580b-46d8-b14d-868dc596222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fda8e79-580b-46d8-b14d-868dc596222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f75225-4409-4a70-9920-765f61112f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f75225-4409-4a70-9920-765f61112f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b09a40-c4be-49ce-8642-04adf21f84e6', 'volume_name': 'volume-e2b09a40-c4be-49ce-8642-04adf21f84e6', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b601758-3d82-4cef-9dfb-b9d6c8745714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b601758-3d82-4cef-9dfb-b9d6c8745714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda74527-232e-450a-96bb-f2609a122358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:34 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Volume e2b09a40-c4be-49ce-8642-04adf21f84e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b09a40-c4be-49ce-8642-04adf21f84e6', 'volume_size': 1} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-149568662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b09a40-c4be-49ce-8642-04adf21f84e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5546e8ca1f48e8bb7d0177d9882dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:34Z,use_quota=True,user_id='310869be27aa427daea6e6846e22a738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Creating volume e2b09a40-c4be-49ce-8642-04adf21f84e6 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:34 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:34 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 1073741824 Jul 01 06:54:34 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:35 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD" returned: 0 in 0.873s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:35 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 was qcow2, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 06:54:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:35 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:35 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:35 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 1073741824" returned: 0 in 1.145s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-c1cb40e8-d6a2-46b6-a0ae-fd484083511c req-e77b4501-2bac-433e-8dde-2c208c7cd5c9 tempest-TestInstancesWithCinderVolumes-1206331780 None] Terminate volume connection completed successfully. Jul 01 06:54:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-c1cb40e8-d6a2-46b6-a0ae-fd484083511c req-e77b4501-2bac-433e-8dde-2c208c7cd5c9 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deleting attachment faeb96fe-d19b-493a-9c9d-69d1661b6e95. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:54:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:35 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 Jul 01 06:54:35 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:36 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda74527-232e-450a-96bb-f2609a122358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b09a40-c4be-49ce-8642-04adf21f84e6', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d73337-bf2a-4b32-97dc-cc1b65ecaa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:36 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Volume volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 (e2b09a40-c4be-49ce-8642-04adf21f84e6): created successfully Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d73337-bf2a-4b32-97dc-cc1b65ecaa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:36 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Flow 'volume_create_manager' (ad326e64-714e-4798-9e03-14eeb26deaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8bab0e01-f105-4a6c-a437-e99034fb7b9f tempest-VolumesTransfersV355Test-776938484 None] Created volume successfully. Jul 01 06:54:37 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 0 in 2.294s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_h1bsn704devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:54:37 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Converted 112.00 MB image at 48.81 MB/s Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:37 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 1G Jul 01 06:54:37 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "cinder-be81af8a-e572-4f69-ae1c-74a9f0df5927-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-be81af8a-e572-4f69-ae1c-74a9f0df5927-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "cinder-quobyte-be81af8a-e572-4f69-ae1c-74a9f0df5927" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-quobyte-be81af8a-e572-4f69-ae1c-74a9f0df5927" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f398a9-0f83-404e-a8ff-36d3fb7742bd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Acquiring lock "cinder-e2b09a40-c4be-49ce-8642-04adf21f84e6-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-e2b09a40-c4be-49ce-8642-04adf21f84e6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:38 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 Jul 01 06:54:38 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Acquiring lock "cinder-quobyte-e2b09a40-c4be-49ce-8642-04adf21f84e6" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-quobyte-e2b09a40-c4be-49ce-8642-04adf21f84e6" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c983bb-2e00-4355-8b85-f2c079e24a75]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:38 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 Jul 01 06:54:38 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:38 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 1G" returned: 0 in 1.037s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3694416-d452-4d49-b112-d395d6f89981]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:39 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:39 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:39 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927" returned: 0 in 1.317s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:39 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6" returned: 0 in 1.090s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:39 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927 Jul 01 06:54:39 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:39 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6 Jul 01 06:54:39 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:40 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 0 in 1.415s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:40 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:40 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:40 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be81af8a-e572-4f69-ae1c-74a9f0df5927" returned: 0 in 1.221s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:40 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2b09a40-c4be-49ce-8642-04adf21f84e6" returned: 0 in 1.210s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-quobyte-be81af8a-e572-4f69-ae1c-74a9f0df5927" released by "delete_volume" :: held 2.631s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-quobyte-e2b09a40-c4be-49ce-8642-04adf21f84e6" released by "delete_volume" :: held 2.386s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:40 devstack cinder-volume[86219]: WARNING cinder.quota [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1371976977-265679084 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1371976977-265679084, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:54:40 devstack cinder-volume[86219]: WARNING cinder.quota [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1371976977-265679084 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1371976977-265679084, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Created reservations ['2396b19d-4c73-48af-84ee-45531f09f3b3', 'a84d3d13-9aab-45bb-a235-d5e219578b67', '31b3616b-0bd9-4f91-a12f-ad28f4878f95', 'c795ef58-a4a9-472f-8c1f-972aa433441e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Created reservations ['ab3b56ad-fe68-4c28-a3a6-06d2c41faa8e', 'cc509214-0326-4983-92cf-e43c21c0c6c7', 'da3b3bf4-c489-4a5a-8726-e0a3801000b1', '790bb51f-d92a-4323-a276-1902bc9fe43d'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:41 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:41 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:41 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:41 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:41 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 1 in 1.347s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Downloaded image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 for user 6667e848cc1a43c48a33c0fd64a9fad1 is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Marking volume 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Copying metadata from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 to 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Creating volume glance metadata for volume 0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 backed by image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6110d320-d02b-47ed-b545-a4a401387792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaf0d19-ee6a-4270-89d7-e74580c4c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:41 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Volume volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 (0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9): created successfully Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaf0d19-ee6a-4270-89d7-e74580c4c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Flow 'volume_create_manager' (b2baca34-23c7-4991-a29a-37634f2835e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:41 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a682e317-af4b-4a1b-ab84-da40bb2d1a54 tempest-VolumesImageMetadata-477086389 None] Created volume successfully. Jul 01 06:54:42 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.186s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:42 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:42 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Deleted volume successfully. Jul 01 06:54:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0c1ba983-6d2c-4804-b016-134e0a759159 tempest-VolumesTransfersV355Test-1780783886 None] Lock "cinder-e2b09a40-c4be-49ce-8642-04adf21f84e6-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:42 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.191s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:42 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:42 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deleted volume successfully. Jul 01 06:54:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-477330fe-0889-4663-b99d-2d0a6da04f84 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-be81af8a-e572-4f69-ae1c-74a9f0df5927-delete_volume" released by "delete_volume" :: held 4.437s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Acquiring lock "cinder-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Lock "cinder-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Acquiring lock "cinder-quobyte-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Lock "cinder-quobyte-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:43 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f1944-e88e-4c1e-b619-1b5e5f809336]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:44 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:44 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:45 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 0 in 1.326s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:45 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:45 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:46 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 1 in 1.088s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:46 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9 Jul 01 06:54:46 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (714d25bf-334f-43e9-991f-1ee8d2c803f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03675c28-affb-4d2b-8e2c-8eebd1612373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03675c28-affb-4d2b-8e2c-8eebd1612373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912150887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7224ed-0e31-46c7-ae0a-da99f808f8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:46Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efaaa7b-46c3-40e5-9b01-be14314dca01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efaaa7b-46c3-40e5-9b01-be14314dca01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198cc4b4-514b-4548-ae70-ebc9f79e86fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198cc4b4-514b-4548-ae70-ebc9f79e86fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7224ed-0e31-46c7-ae0a-da99f808f8c3', 'volume_name': 'volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64939b90-6043-4aef-a820-b0d39fef27b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64939b90-6043-4aef-a820-b0d39fef27b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c6743a-a1e5-4f5d-8f6d-a0202b1ea07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume fb7224ed-0e31-46c7-ae0a-da99f808f8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3', 'volume_size': 1} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912150887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7224ed-0e31-46c7-ae0a-da99f808f8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:46Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating volume fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:46 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:46 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 1073741824 Jul 01 06:54:46 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:46 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-a42671f9-8432-448f-a5ba-db05d3d57d8f req-bbac8d21-3fd2-40c5-aef1-02ac6446b5a8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Terminate volume connection completed successfully. Jul 01 06:54:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-a42671f9-8432-448f-a5ba-db05d3d57d8f req-bbac8d21-3fd2-40c5-aef1-02ac6446b5a8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deleting attachment 827775c2-9f3c-42d2-8e9c-fcd5714ac112. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:54:47 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" returned: 0 in 0.791s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Lock "cinder-quobyte-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9" released by "delete_volume" :: held 3.322s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Created reservations ['aec6873f-02ea-458b-8c68-08ad4bee7c4e', '9138a6a6-4b5e-44ec-90e2-6ba3580c7fd2', 'c17a5b42-c085-418e-af85-60a31b9b7bb1', '2fc0f251-8279-4c3b-bad5-4fa7514ed571'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:47 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:47 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:47 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 1073741824" returned: 0 in 1.017s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:47 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 Jul 01 06:54:47 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:47 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.799s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:47 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Deleted volume successfully. Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-6d6903e0-1d56-4780-b50f-47c5ef79f393 tempest-VolumesImageMetadata-477086389 None] Lock "cinder-0d2d0f4d-24e5-4f79-bb6b-0919d671a5a9-delete_volume" released by "delete_volume" :: held 4.474s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:48 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" returned: 0 in 0.754s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c6743a-a1e5-4f5d-8f6d-a0202b1ea07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9aa956-08f4-457f-b1fd-400dc09dae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 (fb7224ed-0e31-46c7-ae0a-da99f808f8c3): created successfully Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9aa956-08f4-457f-b1fd-400dc09dae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (714d25bf-334f-43e9-991f-1ee8d2c803f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1ba1fd44-9340-4392-bb3e-8b464882b8e0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created volume successfully. Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating offline snapshot 57a0ddf2-9f85-4da4-af97-bc014a1b92c6 of volume fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9865b95-5e42-4d49-8b7d-382c1d96cd01]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:48 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 Jul 01 06:54:48 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:49 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" returned: 0 in 0.927s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:49 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 1G Jul 01 06:54:49 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:50 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 1G" returned: 0 in 0.945s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:50 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 Jul 01 06:54:50 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "cinder-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "cinder-quobyte-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-quobyte-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a1b0fc-8694-4eb9-b3e0-74933a7e69b7]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:51 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:54:51 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:51 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6" returned: 0 in 0.891s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:51 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 is being set with open permissions: ugo+rw Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:51 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 Jul 01 06:54:51 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Flow 'volume_create_manager' (8b9933f3-735c-4642-aefd-16c270f8955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc47d8d-cb0e-4295-8d19-c2eb22cde6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc47d8d-cb0e-4295-8d19-c2eb22cde6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-414663027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a263b6d8-45c2-42f6-b165-7bb91bfa324d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b51bd7f07d4eeabecbc5e73d393108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:52Z,use_quota=True,user_id='dd7217ae82374c9abb10467dfabc22f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549e045c-b590-4f4b-9ebf-550e0fc1ecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549e045c-b590-4f4b-9ebf-550e0fc1ecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61114044-1c61-432a-861a-c58acd23df87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:51 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61114044-1c61-432a-861a-c58acd23df87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a263b6d8-45c2-42f6-b165-7bb91bfa324d', 'volume_name': 'volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3abe1d-7f39-4cb5-9db4-414d65a5eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3abe1d-7f39-4cb5-9db4-414d65a5eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32cd671-034d-4b6d-bd94-773e2c21dbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Volume a263b6d8-45c2-42f6-b165-7bb91bfa324d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d', 'volume_size': 1} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 0 in 0.984s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:52 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:54:52 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:52 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6" returned: 0 in 0.845s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:52 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info Jul 01 06:54:52 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:52 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 1 in 0.794s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:54:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:52 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5 Jul 01 06:54:52 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:53 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info" returned: 0 in 0.773s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:53 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info is being set with open permissions: ugo+rw Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:53 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info Jul 01 06:54:53 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:53 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" returned: 0 in 0.672s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-quobyte-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5" released by "delete_volume" :: held 2.548s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:53 devstack cinder-volume[86219]: WARNING cinder.quota [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273548635-897878070 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273548635-897878070, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:54:53 devstack cinder-volume[86219]: WARNING cinder.quota [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273548635-897878070 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-273548635-897878070, it is now deprecated. Please use the default quota class for default quota. Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Created reservations ['07b690a1-47e3-402b-ba53-25428022dfe9', '222b5c6a-9149-45ea-b412-9019ec979115', 'a4c52bd5-d938-4b3c-a507-ac76644919aa', '894e8a0a-2b0f-4534-9418-612b01defa56'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:53 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:54:53 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:53 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.info" returned: 0 in 0.724s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.236s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-414663027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a263b6d8-45c2-42f6-b165-7bb91bfa324d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b51bd7f07d4eeabecbc5e73d393108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:52Z,use_quota=True,user_id='dd7217ae82374c9abb10467dfabc22f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Creating volume a263b6d8-45c2-42f6-b165-7bb91bfa324d {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:53 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:53 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d 1073741824 Jul 01 06:54:53 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-6877d4e4-0710-4211-9ca1-47aa8ec077c5 tempest-CreateVolumesFromSnapshotTest-889160225 None] Create snapshot completed successfully Jul 01 06:54:54 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.767s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:54 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:54:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Deleted volume successfully. Jul 01 06:54:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c9649625-0810-4fb9-a1c6-761363b608e8 tempest-TestInstancesWithCinderVolumes-1206331780 None] Lock "cinder-8ad16613-3d15-4ac3-8b6b-a6c0eb5e65d5-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:54:55 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d 1073741824" returned: 0 in 1.173s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:55 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d Jul 01 06:54:55 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (1ad6bea5-57b2-4267-8bf4-ad31b3cefec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd62a40e-b45a-49c6-b048-d0d698552070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd62a40e-b45a-49c6-b048-d0d698552070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911287278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af88fc35-7c53-4f04-b553-091f3b58f329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:56Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd6566d-c363-4af4-9fc7-f7c21e3f7399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd6566d-c363-4af4-9fc7-f7c21e3f7399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52a5fe2-ec41-4910-a232-9b1874efa760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52a5fe2-ec41-4910-a232-9b1874efa760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af88fc35-7c53-4f04-b553-091f3b58f329', 'volume_name': 'volume-af88fc35-7c53-4f04-b553-091f3b58f329', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0273fee2-ffbe-4ce8-9bbb-328b143f27f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0273fee2-ffbe-4ce8-9bbb-328b143f27f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a56a8e5-41d3-4336-a4a0-8745159e443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:55 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume af88fc35-7c53-4f04-b553-091f3b58f329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af88fc35-7c53-4f04-b553-091f3b58f329', 'volume_size': 1} Jul 01 06:54:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (b91dc86c-8ad5-45df-907e-1a730c74b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5add97be-384b-465d-8ffc-a0ec6c51ee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5add97be-384b-465d-8ffc-a0ec6c51ee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1619165059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8928ca6f-e56e-48ef-8078-83908bede842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:56Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3a8c14-23c0-4d87-8c63-31088e729967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3a8c14-23c0-4d87-8c63-31088e729967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a6e937-bc29-4e9c-8964-f8aa19a8af1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a6e937-bc29-4e9c-8964-f8aa19a8af1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8928ca6f-e56e-48ef-8078-83908bede842', 'volume_name': 'volume-8928ca6f-e56e-48ef-8078-83908bede842', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0dbf60-63ce-462d-b249-a6639ac379b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0dbf60-63ce-462d-b249-a6639ac379b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b5ecf1-cf31-461a-a73e-20a9b48ef385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume 8928ca6f-e56e-48ef-8078-83908bede842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8928ca6f-e56e-48ef-8078-83908bede842', 'volume_size': 1} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d" returned: 0 in 1.253s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] <== create_volume: return (2482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911287278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af88fc35-7c53-4f04-b553-091f3b58f329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:56Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating volume af88fc35-7c53-4f04-b553-091f3b58f329 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:56 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32cd671-034d-4b6d-bd94-773e2c21dbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ea0f9b-831d-41c8-bf0f-ec81faa4cabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Volume volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d (a263b6d8-45c2-42f6-b165-7bb91bfa324d): created successfully Jul 01 06:54:56 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 1073741824 Jul 01 06:54:56 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ea0f9b-831d-41c8-bf0f-ec81faa4cabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Flow 'volume_create_manager' (8b9933f3-735c-4642-aefd-16c270f8955f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8ed827bc-2416-40cd-b343-88773a9c868f tempest-VolumesTransfersV357Test-163802823 None] Created volume successfully. Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (21f58f05-2581-4284-a885-d468d7be33b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225a4a97-1b81-472c-96c9-72c29246d9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225a4a97-1b81-472c-96c9-72c29246d9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604157818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37962a9-208c-4479-ae0c-659bf5978cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:57Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f801a4d-95a3-49ac-a64b-f5c8f8e098b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f801a4d-95a3-49ac-a64b-f5c8f8e098b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b17008e-9949-4820-add5-766b2a5b951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b17008e-9949-4820-add5-766b2a5b951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37962a9-208c-4479-ae0c-659bf5978cf0', 'volume_name': 'volume-f37962a9-208c-4479-ae0c-659bf5978cf0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481c4d0d-5b01-46fa-909f-b86609368ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481c4d0d-5b01-46fa-909f-b86609368ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe1ba0a-1d8a-4115-9b92-fabc17b68439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume f37962a9-208c-4479-ae0c-659bf5978cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37962a9-208c-4479-ae0c-659bf5978cf0', 'volume_size': 1} Jul 01 06:54:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (d35ddc4c-01f3-4c33-bdc7-98d1de6fc00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d0739f-a453-4d4a-8442-c34affb9d174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d0739f-a453-4d4a-8442-c34affb9d174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726028838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2570649-04a2-4ba7-8663-f782f251de88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:58Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2655040-5769-4bef-8c0c-e342d6080497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2655040-5769-4bef-8c0c-e342d6080497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83cc71c-8433-41fb-b1b0-22af7a711dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83cc71c-8433-41fb-b1b0-22af7a711dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2570649-04a2-4ba7-8663-f782f251de88', 'volume_name': 'volume-e2570649-04a2-4ba7-8663-f782f251de88', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4580d9-db2e-41ec-9a9b-bcf6cbf6a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4580d9-db2e-41ec-9a9b-bcf6cbf6a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2fb21be-52ba-476d-afa8-33d477526cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume e2570649-04a2-4ba7-8663-f782f251de88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2570649-04a2-4ba7-8663-f782f251de88', 'volume_size': 1} Jul 01 06:54:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:58 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 1073741824" returned: 0 in 1.585s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:58 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 Jul 01 06:54:58 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (06337aa0-eff3-4a91-a8a7-2d4f1e11117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d89fb5-40b6-47b2-a533-0717ba70ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d89fb5-40b6-47b2-a533-0717ba70ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12632025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c62a2c2-2d57-4694-8bbb-607a7a65701c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:58Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b91af0-3ad6-4ea5-82fb-0602f62a7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b91af0-3ad6-4ea5-82fb-0602f62a7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be591a89-b0dc-4e58-a0f2-758093c95d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be591a89-b0dc-4e58-a0f2-758093c95d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c62a2c2-2d57-4694-8bbb-607a7a65701c', 'volume_name': 'volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a03dd6-21af-4dd5-98c8-497895142f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a03dd6-21af-4dd5-98c8-497895142f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0251bc-47d4-4f9f-9b31-d525f2567483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume 7c62a2c2-2d57-4694-8bbb-607a7a65701c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c', 'volume_size': 1} Jul 01 06:54:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ff0a4689-bcbc-4c98-95d4-cfa1b3933393 tempest-VolumesTransfersV357Test-2126755125 None] Transfer volume completed successfully. Jul 01 06:54:59 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329" returned: 0 in 0.931s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] <== create_volume: return (2585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.604s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1619165059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8928ca6f-e56e-48ef-8078-83908bede842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:56Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating volume 8928ca6f-e56e-48ef-8078-83908bede842 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:54:59 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a56a8e5-41d3-4336-a4a0-8745159e443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af88fc35-7c53-4f04-b553-091f3b58f329', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:59 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 1073741824 Jul 01 06:54:59 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaed1ea-a2bf-4d75-9f52-e4b0c12cc836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:54:59 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume volume-af88fc35-7c53-4f04-b553-091f3b58f329 (af88fc35-7c53-4f04-b553-091f3b58f329): created successfully Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaed1ea-a2bf-4d75-9f52-e4b0c12cc836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (1ad6bea5-57b2-4267-8bf4-ad31b3cefec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:54:59 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-fc829fd5-83a5-4c10-b5ed-580e783082ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Created volume successfully. Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Acquiring lock "cinder-a263b6d8-45c2-42f6-b165-7bb91bfa324d-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-a263b6d8-45c2-42f6-b165-7bb91bfa324d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Acquiring lock "cinder-quobyte-a263b6d8-45c2-42f6-b165-7bb91bfa324d" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-quobyte-a263b6d8-45c2-42f6-b165-7bb91bfa324d" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f149700-3fee-41ac-b2e7-4f72f2a74dc7]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:54:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:54:59 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d Jul 01 06:54:59 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:00 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 1073741824" returned: 0 in 1.443s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:00 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 Jul 01 06:55:00 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:01 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d" returned: 0 in 1.203s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:01 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d Jul 01 06:55:01 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:01 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842" returned: 0 in 0.922s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] <== create_volume: return (2447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.519s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604157818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37962a9-208c-4479-ae0c-659bf5978cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:57Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating volume f37962a9-208c-4479-ae0c-659bf5978cf0 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:01 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b5ecf1-cf31-461a-a73e-20a9b48ef385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8928ca6f-e56e-48ef-8078-83908bede842', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:01 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 1073741824 Jul 01 06:55:01 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce6519f-96f2-41d7-9e09-fe346cea2646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:01 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume volume-8928ca6f-e56e-48ef-8078-83908bede842 (8928ca6f-e56e-48ef-8078-83908bede842): created successfully Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce6519f-96f2-41d7-9e09-fe346cea2646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (b91dc86c-8ad5-45df-907e-1a730c74b496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8be2561a-fcd4-4677-80c3-528c16a73d31 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created volume successfully. Jul 01 06:55:02 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a263b6d8-45c2-42f6-b165-7bb91bfa324d" returned: 0 in 1.085s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-quobyte-a263b6d8-45c2-42f6-b165-7bb91bfa324d" released by "delete_volume" :: held 2.363s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Created reservations ['3945f338-c9b1-48a2-82f8-d31c38fa55d3', 'ffd48796-e316-4aa8-8861-b2f747b7c246', '7ebab226-e862-4647-bb6e-a953436762d1', '9440db71-5b2f-415c-a0d2-a7d4754bb5f0'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:02 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:02 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:02 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 1073741824" returned: 0 in 1.364s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:02 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 Jul 01 06:55:02 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:03 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.921s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Deleted volume successfully. Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d78d6b31-b86c-41ce-82f1-5f7df93f6930 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-a263b6d8-45c2-42f6-b165-7bb91bfa324d-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:03 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0" returned: 0 in 0.900s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.996s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726028838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2570649-04a2-4ba7-8663-f782f251de88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:58Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating volume e2570649-04a2-4ba7-8663-f782f251de88 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:03 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe1ba0a-1d8a-4115-9b92-fabc17b68439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37962a9-208c-4479-ae0c-659bf5978cf0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:03 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 1073741824 Jul 01 06:55:03 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ea6b98-c7dd-416f-9536-6d5c37914503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:03 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume volume-f37962a9-208c-4479-ae0c-659bf5978cf0 (f37962a9-208c-4479-ae0c-659bf5978cf0): created successfully Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ea6b98-c7dd-416f-9536-6d5c37914503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (21f58f05-2581-4284-a885-d468d7be33b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b113f7e2-bd19-4de2-92a8-02f57bb3862c tempest-CreateVolumesFromSnapshotTest-889160225 None] Created volume successfully. Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Flow 'volume_create_manager' (34ccffc2-9e3c-4e1c-bf19-42f917716da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e906c56-3d37-4f69-8998-0ca883d2ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e906c56-3d37-4f69-8998-0ca883d2ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-214564934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6c0edf-84ad-4a54-902f-5b5afb4804d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b51bd7f07d4eeabecbc5e73d393108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:04Z,use_quota=True,user_id='dd7217ae82374c9abb10467dfabc22f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4d248f-3bd3-41ac-aa73-dabe28472369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4d248f-3bd3-41ac-aa73-dabe28472369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf77f210-71d6-48e6-9812-04d5510ee31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf77f210-71d6-48e6-9812-04d5510ee31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6c0edf-84ad-4a54-902f-5b5afb4804d2', 'volume_name': 'volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e914f7-552e-446d-9c8d-b584d4e0e08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e914f7-552e-446d-9c8d-b584d4e0e08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8de1850-b0d0-43fd-8314-462862b728ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:04 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Volume 0c6c0edf-84ad-4a54-902f-5b5afb4804d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2', 'volume_size': 1} Jul 01 06:55:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:05 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 1073741824" returned: 0 in 1.336s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:05 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 Jul 01 06:55:05 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:05 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88" returned: 0 in 0.686s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.683s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12632025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c62a2c2-2d57-4694-8bbb-607a7a65701c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4557da23298b4943a49a17e0ff229fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:54:58Z,use_quota=True,user_id='0b87fbb5fab1482e9a669de2915bb28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Creating volume 7c62a2c2-2d57-4694-8bbb-607a7a65701c {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:05 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:05 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c 1073741824 Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2fb21be-52ba-476d-afa8-33d477526cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2570649-04a2-4ba7-8663-f782f251de88', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bf0cb7-b909-4432-8bc6-232388eaa83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:05 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:06 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume volume-e2570649-04a2-4ba7-8663-f782f251de88 (e2570649-04a2-4ba7-8663-f782f251de88): created successfully Jul 01 06:55:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bf0cb7-b909-4432-8bc6-232388eaa83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (d35ddc4c-01f3-4c33-bdc7-98d1de6fc00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-28be7699-2963-424d-8fdb-9f295db238f7 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created volume successfully. Jul 01 06:55:06 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c 1073741824" returned: 0 in 1.030s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:07 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c Jul 01 06:55:07 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:07 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c" returned: 0 in 0.745s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.421s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-214564934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6c0edf-84ad-4a54-902f-5b5afb4804d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b51bd7f07d4eeabecbc5e73d393108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:04Z,use_quota=True,user_id='dd7217ae82374c9abb10467dfabc22f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Creating volume 0c6c0edf-84ad-4a54-902f-5b5afb4804d2 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:07 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0251bc-47d4-4f9f-9b31-d525f2567483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d7c952-2847-4291-8faf-4f3273ea551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:07 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 1073741824 Jul 01 06:55:07 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Volume volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c (7c62a2c2-2d57-4694-8bbb-607a7a65701c): created successfully Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d7c952-2847-4291-8faf-4f3273ea551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Flow 'volume_create_manager' (06337aa0-eff3-4a91-a8a7-2d4f1e11117d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0d0f3a58-812f-401d-b1a2-693dd58635ea tempest-CreateVolumesFromSnapshotTest-889160225 None] Created volume successfully. Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-7c62a2c2-2d57-4694-8bbb-607a7a65701c-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-7c62a2c2-2d57-4694-8bbb-607a7a65701c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-7c62a2c2-2d57-4694-8bbb-607a7a65701c" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-7c62a2c2-2d57-4694-8bbb-607a7a65701c" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1229535-98c9-4bb5-90f4-048244396f98]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:08 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c Jul 01 06:55:08 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:08 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 1073741824" returned: 0 in 1.198s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:09 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 Jul 01 06:55:09 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:09 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c" returned: 0 in 0.899s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:09 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c Jul 01 06:55:09 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:09 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2" returned: 0 in 0.783s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8de1850-b0d0-43fd-8314-462862b728ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7de5c8c-9f0b-4454-8772-f1f626f3f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Volume volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 (0c6c0edf-84ad-4a54-902f-5b5afb4804d2): created successfully Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7de5c8c-9f0b-4454-8772-f1f626f3f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Flow 'volume_create_manager' (34ccffc2-9e3c-4e1c-bf19-42f917716da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4de69e48-1bd0-4804-8d7b-c33dfce5bc0b tempest-VolumesTransfersV357Test-163802823 None] Created volume successfully. Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Flow 'volume_create_manager' (5ed0c997-98e4-4c2b-a740-f2b8a8681180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c2d168-8c45-4999-94c4-9b6daf10ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c2d168-8c45-4999-94c4-9b6daf10ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243674038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724827cf-9909-486d-b110-0741b9e7614a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b04230355b040debd56a66f9121bbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:10Z,use_quota=True,user_id='4167b98981e84d7b88903a31da212068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728b51a7-5301-47ce-97da-6f1b3e23ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728b51a7-5301-47ce-97da-6f1b3e23ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7b0030-5eef-49c3-94ef-5fe76838199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7b0030-5eef-49c3-94ef-5fe76838199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724827cf-9909-486d-b110-0741b9e7614a', 'volume_name': 'volume-724827cf-9909-486d-b110-0741b9e7614a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:10 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec18fc8-43d8-4148-8c13-f066ded58af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec18fc8-43d8-4148-8c13-f066ded58af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5d993a-cc0f-4c78-b810-b81a43bb6eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Volume 724827cf-9909-486d-b110-0741b9e7614a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724827cf-9909-486d-b110-0741b9e7614a', 'volume_size': 1} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243674038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724827cf-9909-486d-b110-0741b9e7614a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b04230355b040debd56a66f9121bbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:10Z,use_quota=True,user_id='4167b98981e84d7b88903a31da212068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Creating volume 724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:10 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7c62a2c2-2d57-4694-8bbb-607a7a65701c" returned: 0 in 0.892s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:10 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a 1073741824 Jul 01 06:55:10 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-7c62a2c2-2d57-4694-8bbb-607a7a65701c" released by "delete_volume" :: held 1.872s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['c750e347-99ea-4831-8b6e-dc98a1cd3c0d', 'df60f505-29f1-4322-8363-3f14ead680aa', '0b521782-fb3b-481a-b19e-2a83b29fd432', '98b5c98c-59ce-43b3-ba02-73343705a82d'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:10 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:10 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-e2570649-04a2-4ba7-8663-f782f251de88-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-e2570649-04a2-4ba7-8663-f782f251de88-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-e2570649-04a2-4ba7-8663-f782f251de88" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-e2570649-04a2-4ba7-8663-f782f251de88" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f85b78-f516-4543-8cdf-c09a329ebb9a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:11 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 Jul 01 06:55:11 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Acquiring lock "cinder-0c6c0edf-84ad-4a54-902f-5b5afb4804d2-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-0c6c0edf-84ad-4a54-902f-5b5afb4804d2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Acquiring lock "cinder-quobyte-0c6c0edf-84ad-4a54-902f-5b5afb4804d2" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:11 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.008s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:11 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleted volume successfully. Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-quobyte-0c6c0edf-84ad-4a54-902f-5b5afb4804d2" acquired by "delete_volume" :: waited 0.040s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9e43311e-a315-4396-959f-62537d53ebad tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-7c62a2c2-2d57-4694-8bbb-607a7a65701c-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5893cc-16c2-4221-a351-52136ddc46e2]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:11 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a 1073741824" returned: 0 in 1.322s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:11 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 Jul 01 06:55:11 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:11 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:55:11 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:11 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88" returned: 0 in 1.057s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:11 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88 Jul 01 06:55:11 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:12 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2" returned: 0 in 0.931s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:12 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2 Jul 01 06:55:12 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:12 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 0.890s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] <== create_volume: return (2274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5d993a-cc0f-4c78-b810-b81a43bb6eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724827cf-9909-486d-b110-0741b9e7614a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dcb9d2-080a-494a-ad08-cefcd1329e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Volume volume-724827cf-9909-486d-b110-0741b9e7614a (724827cf-9909-486d-b110-0741b9e7614a): created successfully Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dcb9d2-080a-494a-ad08-cefcd1329e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Flow 'volume_create_manager' (5ed0c997-98e4-4c2b-a740-f2b8a8681180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-40e2d950-35a5-4513-9831-29f5702f4f62 tempest-VolumesActionsTest-1179039627 None] Created volume successfully. Jul 01 06:55:12 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e2570649-04a2-4ba7-8663-f782f251de88" returned: 0 in 0.784s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-e2570649-04a2-4ba7-8663-f782f251de88" released by "delete_volume" :: held 1.903s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['b8647d3f-8f6e-4109-9ef6-62a4664deaac', 'dc149e2a-84aa-4a6d-a6b5-518a72a2a488', '640ac5a1-d08b-4de2-b738-bd7eb8a2a791', '42886740-9156-4d83-9e4d-f076357633cf'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:12 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:12 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-f37962a9-208c-4479-ae0c-659bf5978cf0-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-f37962a9-208c-4479-ae0c-659bf5978cf0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-f37962a9-208c-4479-ae0c-659bf5978cf0" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-f37962a9-208c-4479-ae0c-659bf5978cf0" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2972fcc-8fd3-4341-821d-a26d26bb20c0]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:13 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0c6c0edf-84ad-4a54-902f-5b5afb4804d2" returned: 0 in 0.768s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-quobyte-0c6c0edf-84ad-4a54-902f-5b5afb4804d2" released by "delete_volume" :: held 1.756s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Created reservations ['af0d6fe0-e3da-4850-87ee-b48a4fd42e03', 'a362d62c-4b3e-4457-a2f9-3bbb5ccff7c6', '708d6a8c-cfa3-4024-8361-90225b29fc52', '56e4e8ce-5586-470a-80a1-57a4a6d623ce'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:13 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 Jul 01 06:55:13 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:13 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:13 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:13 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.933s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleted volume successfully. Jul 01 06:55:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2fbb7909-7d9f-4779-b7b3-b02fd6956a05 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-e2570649-04a2-4ba7-8663-f782f251de88-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:14 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0" returned: 0 in 1.216s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:14 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0 Jul 01 06:55:14 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:14 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.138s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:14 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Deleted volume successfully. Jul 01 06:55:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-bfa38e4f-e51a-40d7-b38f-c920490ae4c9 tempest-VolumesTransfersV357Test-1091673216 None] Lock "cinder-0c6c0edf-84ad-4a54-902f-5b5afb4804d2-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:15 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f37962a9-208c-4479-ae0c-659bf5978cf0" returned: 0 in 1.153s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-f37962a9-208c-4479-ae0c-659bf5978cf0" released by "delete_volume" :: held 2.424s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['7fb20396-1e71-4347-bc3d-09c90adfe09e', 'caef6d5b-1f27-45f4-bc2d-236d040bf7c9', 'c84af2a9-035a-44cf-b318-b9db4bba099d', 'a23044a4-57d0-4a10-8b82-4e00fcd49367'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:15 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:15 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-8928ca6f-e56e-48ef-8078-83908bede842-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-8928ca6f-e56e-48ef-8078-83908bede842-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-8928ca6f-e56e-48ef-8078-83908bede842" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-8928ca6f-e56e-48ef-8078-83908bede842" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:16 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.876s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleted volume successfully. Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[520be6e4-2be8-4f62-98f8-445ce429cba6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7aba78f7-473f-439b-9a3c-707e5ca8f7c0 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-f37962a9-208c-4479-ae0c-659bf5978cf0-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:16 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 Jul 01 06:55:16 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:17 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842" returned: 0 in 1.101s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:17 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842 Jul 01 06:55:17 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:18 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8928ca6f-e56e-48ef-8078-83908bede842" returned: 0 in 0.780s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-8928ca6f-e56e-48ef-8078-83908bede842" released by "delete_volume" :: held 1.968s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=106,cinder:INSERT=40,cinder:UPDATE=146,cinder:DELETE=14 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=144,cinder:SELECT=112,cinder:DELETE=12,cinder:INSERT=38 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['983c1ad1-8fa9-42ea-b13d-74ff3a4289d8', '0de432a1-5461-4a73-91ac-33b8d61618e6', '0859f870-d99a-433c-91b9-f7fd3c077a3e', '927cee7b-6254-4eff-8baa-42980b884567'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:18 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:18 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-af88fc35-7c53-4f04-b553-091f3b58f329-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-af88fc35-7c53-4f04-b553-091f3b58f329-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-af88fc35-7c53-4f04-b553-091f3b58f329" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-af88fc35-7c53-4f04-b553-091f3b58f329" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5b403-2473-4a41-aaf8-9d47f15cf59f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:19 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 Jul 01 06:55:19 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:20 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.177s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:20 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleted volume successfully. Jul 01 06:55:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e95ff769-1330-43ce-973b-f77226113af4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-8928ca6f-e56e-48ef-8078-83908bede842-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:20 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329" returned: 0 in 1.218s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:20 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329 Jul 01 06:55:20 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:21 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af88fc35-7c53-4f04-b553-091f3b58f329" returned: 0 in 1.122s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-af88fc35-7c53-4f04-b553-091f3b58f329" released by "delete_volume" :: held 2.434s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['ac2a8653-1138-4c4e-8a02-43234b2ff170', '2fae4bd8-e83e-4237-af4e-763fd67ad771', 'a6e40f79-3d1c-4a7b-b6d9-d69dea04edce', 'b84b3fab-d7e6-4e60-935a-dee59a7f7eea'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:21 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:21 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-57a0ddf2-9f85-4da4-af97-bc014a1b92c6-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-57a0ddf2-9f85-4da4-af97-bc014a1b92c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-57a0ddf2-9f85-4da4-af97-bc014a1b92c6" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-57a0ddf2-9f85-4da4-af97-bc014a1b92c6" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleting offline snapshot 57a0ddf2-9f85-4da4-af97-bc014a1b92c6 of volume fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] snapshot_file for this snap is: volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f176eb3-9a49-4388-bc97-3497c0d53590]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:22 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 Jul 01 06:55:22 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:22 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.255s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:22 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:23 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleted volume successfully. Jul 01 06:55:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ee96c0e1-fa2a-4814-b63a-a843f0945494 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-af88fc35-7c53-4f04-b553-091f3b58f329-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:23 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6" returned: 0 in 1.181s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:55:23 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0467f232-ab89-49c9-81b3-460c5f1af263]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:24 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 Jul 01 06:55:24 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Flow 'volume_create_manager' (00cda794-fbc3-4941-8b14-6b74d70867fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c6f8d2-e40c-47b2-8639-cde8e2940d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c6f8d2-e40c-47b2-8639-cde8e2940d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1948305995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39023514-c87b-4463-958e-fd6cc396c81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d7eadf36f348428ad6e7e7be69dce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:25Z,use_quota=True,user_id='905ccc5545974e7580953063977aef41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db601c4-aa88-4d58-9988-62c562e0afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db601c4-aa88-4d58-9988-62c562e0afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671d629d-f2fd-4447-88e7-90a857c2af13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671d629d-f2fd-4447-88e7-90a857c2af13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39023514-c87b-4463-958e-fd6cc396c81f', 'volume_name': 'volume-39023514-c87b-4463-958e-fd6cc396c81f', 'volume_size': 2}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ca959c-3342-4cdc-9c5f-c6339f969346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ca959c-3342-4cdc-9c5f-c6339f969346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcae29d-81a0-4b8a-90d1-f06c487d88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:24 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Volume 39023514-c87b-4463-958e-fd6cc396c81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39023514-c87b-4463-958e-fd6cc396c81f', 'volume_size': 2} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1948305995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39023514-c87b-4463-958e-fd6cc396c81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d7eadf36f348428ad6e7e7be69dce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:25Z,use_quota=True,user_id='905ccc5545974e7580953063977aef41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Creating volume 39023514-c87b-4463-958e-fd6cc396c81f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:24 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f 2147483648 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:24 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f 2147483648 Jul 01 06:55:24 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:24 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" returned: 0 in 0.951s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:24 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 Jul 01 06:55:24 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:25 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f 2147483648" returned: 0 in 1.021s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:25 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f Jul 01 06:55:25 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:25 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6" returned: 0 in 0.926s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:25 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6 Jul 01 06:55:25 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:26 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f" returned: 0 in 0.731s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:26 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:26 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcae29d-81a0-4b8a-90d1-f06c487d88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39023514-c87b-4463-958e-fd6cc396c81f', 'volume_size': 2}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de56ebdd-4b88-4054-9cd5-22f4ba1ae6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:26 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Volume volume-39023514-c87b-4463-958e-fd6cc396c81f (39023514-c87b-4463-958e-fd6cc396c81f): created successfully Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de56ebdd-4b88-4054-9cd5-22f4ba1ae6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Flow 'volume_create_manager' (00cda794-fbc3-4941-8b14-6b74d70867fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9d01c02b-0bd8-4fc8-a860-80556a4ecf27 tempest-VolumesCloneNegativeTest-781939124 None] Created volume successfully. Jul 01 06:55:26 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3.57a0ddf2-9f85-4da4-af97-bc014a1b92c6" returned: 0 in 0.893s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-57a0ddf2-9f85-4da4-af97-bc014a1b92c6" released by "_delete_snapshot" :: held 4.151s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" released by "delete_snapshot" :: held 4.204s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['15e5f689-5cb8-4f9c-859c-7202053fb06d', '94ecc907-029d-484d-b27f-0ed5d5aa982e', '3e7014da-1f15-422a-b798-bd89e3749f3e', '52ea5c95-8aac-412c-9333-e64183b01a56'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Delete snapshot completed successfully. Jul 01 06:55:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e50de2dc-96ef-44c4-8364-ab8d6e911c0e tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-57a0ddf2-9f85-4da4-af97-bc014a1b92c6-delete_snapshot" released by "delete_snapshot" :: held 4.409s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Acquiring lock "cinder-39023514-c87b-4463-958e-fd6cc396c81f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Lock "cinder-39023514-c87b-4463-958e-fd6cc396c81f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:27 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.917s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Acquiring lock "cinder-quobyte-39023514-c87b-4463-958e-fd6cc396c81f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Lock "cinder-quobyte-39023514-c87b-4463-958e-fd6cc396c81f" acquired by "delete_volume" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd7cc2-6ee7-4d2c-8960-48a7aa53fff4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:27 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f Jul 01 06:55:27 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-fb7224ed-0e31-46c7-ae0a-da99f808f8c3-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-fb7224ed-0e31-46c7-ae0a-da99f808f8c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "cinder-quobyte-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" acquired by "delete_volume" :: waited 0.036s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f45ac0-1a65-4dae-bc73-7d789a5f13c2]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:28 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 Jul 01 06:55:28 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:28 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f" returned: 0 in 0.969s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:28 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f Jul 01 06:55:28 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:29 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" returned: 0 in 0.967s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:29 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3 Jul 01 06:55:29 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:29 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-39023514-c87b-4463-958e-fd6cc396c81f" returned: 0 in 0.795s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Lock "cinder-quobyte-39023514-c87b-4463-958e-fd6cc396c81f" released by "delete_volume" :: held 1.819s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Created reservations ['dabab6b5-aa85-4ad7-99a2-aef94e8b29a9', 'a633499b-eb52-4af2-829c-f397067a9399', '4dbe7aca-833f-4ff6-9999-133a8a709e17', '2bb668dc-3f55-412c-86c8-2f66e118ef04'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:29 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:29 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:29 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" returned: 0 in 0.819s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-quobyte-fb7224ed-0e31-46c7-ae0a-da99f808f8c3" released by "delete_volume" :: held 1.879s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Created reservations ['6a8e66c8-540a-48e6-9d66-aa9d79080286', 'af4da833-6f22-424d-8fd3-a337436a3f70', 'e0df90a4-756f-4daa-8c75-8d9f6875db1a', '17c458cc-7916-40d9-b61b-58bfdbf8fdf8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:30 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:55:30 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:30 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.401s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:30 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Deleted volume successfully. Jul 01 06:55:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d1704f0e-6a61-41ba-b979-a5e1288f147b tempest-VolumesCloneNegativeTest-781939124 None] Lock "cinder-39023514-c87b-4463-958e-fd6cc396c81f-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:31 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.282s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:31 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:55:31 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Deleted volume successfully. Jul 01 06:55:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7136ae6e-c295-4d80-a4f5-762ee07d16d4 tempest-CreateVolumesFromSnapshotTest-889160225 None] Lock "cinder-fb7224ed-0e31-46c7-ae0a-da99f808f8c3-delete_volume" released by "delete_volume" :: held 3.556s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb69124-904a-43b9-ad45-d7327fd45615 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "cinder-724827cf-9909-486d-b110-0741b9e7614a" by "attach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb69124-904a-43b9-ad45-d7327fd45615 tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a" acquired by "attach_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7fb69124-904a-43b9-ad45-d7327fd45615 tempest-VolumesActionsTest-1179039627 None] Attaching volume 724827cf-9909-486d-b110-0741b9e7614a to instance ddaa443b-e654-4f94-b114-86552a9dae20 at mountpoint /dev/vdb on host None. Jul 01 06:55:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7fb69124-904a-43b9-ad45-d7327fd45615 tempest-VolumesActionsTest-1179039627 None] Attach volume completed successfully. Jul 01 06:55:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb69124-904a-43b9-ad45-d7327fd45615 tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a" released by "attach_volume" :: held 0.152s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8c7d7dde-624b-4a73-b9c2-493ec78b95df tempest-VolumesActionsTest-1179039627 None] Acquiring lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-detach_volume" by "detach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8c7d7dde-624b-4a73-b9c2-493ec78b95df tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8c7d7dde-624b-4a73-b9c2-493ec78b95df tempest-VolumesActionsTest-1179039627 None] Detaching volume 724827cf-9909-486d-b110-0741b9e7614a from instance ddaa443b-e654-4f94-b114-86552a9dae20. Jul 01 06:55:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8c7d7dde-624b-4a73-b9c2-493ec78b95df tempest-VolumesActionsTest-1179039627 None] Detach volume completed successfully. Jul 01 06:55:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8c7d7dde-624b-4a73-b9c2-493ec78b95df tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Flow 'volume_create_manager' (2aaa12a0-3377-4f60-9494-66239cb8bba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8459c45-7c9d-4025-b85a-4f3d07fe1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8459c45-7c9d-4025-b85a-4f3d07fe1f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e410f32-9119-4842-bebc-f778b1b9ee81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694995b70428da12fa1b2b14df968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:42Z,use_quota=True,user_id='a143ed05ff594cb6b864934929cdb5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc27f85-60ee-46a5-ba0d-84fd621f4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc27f85-60ee-46a5-ba0d-84fd621f4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a087587a-53fe-4bc5-ade3-349db25f0174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a087587a-53fe-4bc5-ade3-349db25f0174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e410f32-9119-4842-bebc-f778b1b9ee81', 'volume_name': 'volume-5e410f32-9119-4842-bebc-f778b1b9ee81', 'volume_size': 1, 'image_id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e887e616-e854-4939-8175-7a3cb0d8ce4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c6dcf1c5842449bdaa4fb88fc99e8b8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f5694995b70428da12fa1b2b14df968', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b189e14b872923206173bfb30f0b4d9e9c8773248dc8d30859754cfb77a411d001388544625bdfcd462cddce196409cf77bdee4f273f3853dffe98cad3428259', 'id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'created_at': datetime.datetime(2026, 7, 1, 4, 55, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 55, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e887e616-e854-4939-8175-7a3cb0d8ce4f/file', 'properties': {}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35c500d-4ad7-4159-8e91-f5eeac7c158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35c500d-4ad7-4159-8e91-f5eeac7c158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ab62cf-3aa5-4a1d-9740-606cd7b6798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:42 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Volume 5e410f32-9119-4842-bebc-f778b1b9ee81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e410f32-9119-4842-bebc-f778b1b9ee81', 'volume_size': 1, 'image_id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e887e616-e854-4939-8175-7a3cb0d8ce4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c6dcf1c5842449bdaa4fb88fc99e8b8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f5694995b70428da12fa1b2b14df968', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b189e14b872923206173bfb30f0b4d9e9c8773248dc8d30859754cfb77a411d001388544625bdfcd462cddce196409cf77bdee4f273f3853dffe98cad3428259', 'id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'created_at': datetime.datetime(2026, 7, 1, 4, 55, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 55, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e887e616-e854-4939-8175-7a3cb0d8ce4f/file', 'properties': {}}, 'image_service': } Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Trying to clone 5e410f32-9119-4842-bebc-f778b1b9ee81 from image e887e616-e854-4939-8175-7a3cb0d8ce4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e887e616-e854-4939-8175-7a3cb0d8ce4f', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 06:55:42 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Image download 0.00 MB at 0.00 MB/s Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60ceae1-3a5f-4e8d-9029-6ca6a8aa903e]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:43 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD Jul 01 06:55:43 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:43 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD" returned: 0 in 1.010s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:43 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD Jul 01 06:55:43 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:44 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD" returned: 1 in 0.797s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:55:44 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Temporary image e887e616-e854-4939-8175-7a3cb0d8ce4f is fetched for user a143ed05ff594cb6b864934929cdb5af. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 06:55:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[178ba917-9996-4876-8370-ff52f06a31b4]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:44 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD Jul 01 06:55:44 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:45 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD" returned: 0 in 0.941s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:45 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD Jul 01 06:55:45 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:46 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD" returned: 1 in 0.859s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e410f32-9119-4842-bebc-f778b1b9ee81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5694995b70428da12fa1b2b14df968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:55:42Z,use_quota=True,user_id='a143ed05ff594cb6b864934929cdb5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Creating volume 5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:55:46 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:55:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:46 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 1073741824 Jul 01 06:55:46 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:47 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 1073741824" returned: 0 in 1.169s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:47 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:55:47 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:48 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 0 in 1.215s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:49 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:55:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:55:49 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Attempting download of e887e616-e854-4939-8175-7a3cb0d8ce4f ((None, [{'url': 'file:///opt/stack/data/glance/images/e887e616-e854-4939-8175-7a3cb0d8ce4f', 'metadata': {}}])) to volume 5e410f32-9119-4842-bebc-f778b1b9ee81. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 06:55:49 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[28941beb-8a69-4f15-abb5-f4af06f4114a]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:49 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6 Jul 01 06:55:49 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6" returned: 0 in 1.095s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:50 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:50 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6 Jul 01 06:55:50 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:51 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6" returned: 1 in 1.196s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e887e616-e854-4939-8175-7a3cb0d8ce4f_gtuw5qv6' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:55:51 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec4dad1-6a43-464a-8277-f8bc77edd05c]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:51 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD Jul 01 06:55:51 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:52 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD" returned: 0 in 0.857s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:52 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD Jul 01 06:55:52 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:53 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD" returned: 1 in 0.818s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] e887e616-e854-4939-8175-7a3cb0d8ce4f was raw, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:53 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:55:53 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:53 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 0 in 0.891s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e887e616-e854-4939-8175-7a3cb0d8ce4f_bo23sr39devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:55:53 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 06:55:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:54 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 1G Jul 01 06:55:54 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:54 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 1G" returned: 0 in 0.829s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[61948cfb-b562-4a84-b097-da15f44a7cf1]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:55 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:55:55 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:55 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 0 in 1.019s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:56 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:55:56 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:55:57 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 1 in 1.582s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Downloaded image e887e616-e854-4939-8175-7a3cb0d8ce4f ((None, [{'url': 'file:///opt/stack/data/glance/images/e887e616-e854-4939-8175-7a3cb0d8ce4f', 'metadata': {}}])) to volume 5e410f32-9119-4842-bebc-f778b1b9ee81 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Temporary image e887e616-e854-4939-8175-7a3cb0d8ce4f for user a143ed05ff594cb6b864934929cdb5af is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Marking volume 5e410f32-9119-4842-bebc-f778b1b9ee81 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Copying metadata from image e887e616-e854-4939-8175-7a3cb0d8ce4f to 5e410f32-9119-4842-bebc-f778b1b9ee81. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Creating volume glance metadata for volume 5e410f32-9119-4842-bebc-f778b1b9ee81 backed by image e887e616-e854-4939-8175-7a3cb0d8ce4f with: {'image_id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c6dcf1c5842449bdaa4fb88fc99e8b8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ab62cf-3aa5-4a1d-9740-606cd7b6798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e410f32-9119-4842-bebc-f778b1b9ee81', 'volume_size': 1, 'image_id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e887e616-e854-4939-8175-7a3cb0d8ce4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c6dcf1c5842449bdaa4fb88fc99e8b8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f5694995b70428da12fa1b2b14df968', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b189e14b872923206173bfb30f0b4d9e9c8773248dc8d30859754cfb77a411d001388544625bdfcd462cddce196409cf77bdee4f273f3853dffe98cad3428259', 'id': 'e887e616-e854-4939-8175-7a3cb0d8ce4f', 'created_at': datetime.datetime(2026, 7, 1, 4, 55, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 55, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e887e616-e854-4939-8175-7a3cb0d8ce4f/file', 'properties': {}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf806e7-bc62-4158-a100-bfbad698b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:55:57 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Volume volume-5e410f32-9119-4842-bebc-f778b1b9ee81 (5e410f32-9119-4842-bebc-f778b1b9ee81): created successfully Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf806e7-bc62-4158-a100-bfbad698b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:55:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Flow 'volume_create_manager' (2aaa12a0-3377-4f60-9494-66239cb8bba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:55:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4d88290e-74a9-4177-868d-179caa857916 tempest-VolumeImageDependencyTests-891190841 None] Created volume successfully. Jul 01 06:55:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Acquiring lock "cinder-5e410f32-9119-4842-bebc-f778b1b9ee81-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Lock "cinder-5e410f32-9119-4842-bebc-f778b1b9ee81-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Acquiring lock "cinder-quobyte-5e410f32-9119-4842-bebc-f778b1b9ee81" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:55:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Lock "cinder-quobyte-5e410f32-9119-4842-bebc-f778b1b9ee81" acquired by "delete_volume" :: waited 0.044s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:55:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d22e63-a917-45c7-a69a-edaf70654c4e]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:55:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:55:59 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:55:59 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:00 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 0 in 1.453s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:00 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:56:00 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:01 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 1 in 1.155s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:56:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:02 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81 Jul 01 06:56:02 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:02 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-5e410f32-9119-4842-bebc-f778b1b9ee81" returned: 0 in 0.856s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Lock "cinder-quobyte-5e410f32-9119-4842-bebc-f778b1b9ee81" released by "delete_volume" :: held 3.665s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:02 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Created reservations ['14aa8a47-6d32-44f3-bf85-70bf3c7982c7', '2713de08-2664-40d4-bd46-f893c53e7570', '6cf533f3-1dfb-4ba8-8726-6f40d03b360a', '7508c1bd-9709-4246-a47e-67a7be8842c3'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:03 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:56:03 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:03 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:03 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:56:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Deleted volume successfully. Jul 01 06:56:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f02f62de-8f05-4c2f-86c5-4903e9a5bb7a tempest-VolumeImageDependencyTests-891190841 None] Lock "cinder-5e410f32-9119-4842-bebc-f778b1b9ee81-delete_volume" released by "delete_volume" :: held 4.929s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Flow 'volume_create_manager' (85af0f27-5fb8-4a53-b35d-a0d361478888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a1569-b4b2-49e8-932d-6cf7263562c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a1569-b4b2-49e8-932d-6cf7263562c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-47745016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db1031d-4a98-48eb-8c85-7d0ef57fb1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72835c38f9f64c66982dff8d455f4a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:06Z,use_quota=True,user_id='3381267c23474c9588b198e48761eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584ee46c-b4d2-46ec-ba49-13a3f631758b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584ee46c-b4d2-46ec-ba49-13a3f631758b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4e86ac-e953-4862-a57e-487c052822eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4e86ac-e953-4862-a57e-487c052822eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db1031d-4a98-48eb-8c85-7d0ef57fb1be', 'volume_name': 'volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd60c8b-d25d-4a10-9a45-b5fa3a8d43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd60c8b-d25d-4a10-9a45-b5fa3a8d43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d523cc84-6570-437b-a1e2-a4be37e77fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:05 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Volume 1db1031d-4a98-48eb-8c85-7d0ef57fb1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be', 'volume_size': 1} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-47745016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db1031d-4a98-48eb-8c85-7d0ef57fb1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72835c38f9f64c66982dff8d455f4a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:06Z,use_quota=True,user_id='3381267c23474c9588b198e48761eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Creating volume 1db1031d-4a98-48eb-8c85-7d0ef57fb1be {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:56:05 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:56:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:05 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be 1073741824 Jul 01 06:56:05 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:06 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:56:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Flow 'volume_create_manager' (02c54417-076d-46b7-85e1-2a9e4f98917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b47337e-3c38-45cc-bb45-0b95c96e7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b47337e-3c38-45cc-bb45-0b95c96e7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1649104822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e46f4-d01f-420e-a66f-2318f6fd4ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72835c38f9f64c66982dff8d455f4a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:07Z,use_quota=True,user_id='3381267c23474c9588b198e48761eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7549709f-0529-48b3-839d-0e18711437c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7549709f-0529-48b3-839d-0e18711437c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c55290-c4fc-4856-8ac1-cff9f0f90b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c55290-c4fc-4856-8ac1-cff9f0f90b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4e46f4-d01f-420e-a66f-2318f6fd4ae3', 'volume_name': 'volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825cf03c-5337-4816-b08c-b6e44dec2098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825cf03c-5337-4816-b08c-b6e44dec2098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dd6adc-02c2-4098-aaec-79c9acba56a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Volume 7a4e46f4-d01f-420e-a66f-2318f6fd4ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3', 'volume_size': 1} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:07 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be 1073741824" returned: 0 in 1.803s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:07 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be Jul 01 06:56:07 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Flow 'volume_create_manager' (39c7791c-2f60-49ff-87c4-680df3bab12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19936c52-357c-40d0-9248-ceafb76dc849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19936c52-357c-40d0-9248-ceafb76dc849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-301299196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb0e965-1e36-4d57-88c9-d9ad07e9651b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23994ed069814d09a7434ca02bd6e353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:08Z,use_quota=True,user_id='e5c2f329e60a4075a27a86a0f1c76c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e3337f-267a-492b-89d9-9eee084d95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e3337f-267a-492b-89d9-9eee084d95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d41d079-0ecf-4b8d-8f5a-bec0a23bce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d41d079-0ecf-4b8d-8f5a-bec0a23bce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb0e965-1e36-4d57-88c9-d9ad07e9651b', 'volume_name': 'volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744cfb0a-e9b3-47c5-a9c4-c240930f2b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744cfb0a-e9b3-47c5-a9c4-c240930f2b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b116fbab-cd71-4dff-a89e-7b4c1b69ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:08 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Volume cdb0e965-1e36-4d57-88c9-d9ad07e9651b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b', 'volume_size': 1} Jul 01 06:56:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:09 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" returned: 0 in 1.847s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] <== create_volume: return (3778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.783s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1649104822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e46f4-d01f-420e-a66f-2318f6fd4ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72835c38f9f64c66982dff8d455f4a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:07Z,use_quota=True,user_id='3381267c23474c9588b198e48761eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Creating volume 7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:56:09 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d523cc84-6570-437b-a1e2-a4be37e77fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cd14b3-ef24-416d-a1f5-42c3de367299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:09 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 1073741824 Jul 01 06:56:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Volume volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be (1db1031d-4a98-48eb-8c85-7d0ef57fb1be): created successfully Jul 01 06:56:09 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cd14b3-ef24-416d-a1f5-42c3de367299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Flow 'volume_create_manager' (85af0f27-5fb8-4a53-b35d-a0d361478888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e349216e-77c2-4ea0-80fb-a4e25d8229e9 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Created volume successfully. Jul 01 06:56:11 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 1073741824" returned: 0 in 2.008s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:11 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 Jul 01 06:56:11 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9a33aff0-6db6-40f6-8dd2-4ba49a9bc30b tempest-VolumesActionsTest-1179039627 None] Acquiring lock "cinder-724827cf-9909-486d-b110-0741b9e7614a" by "attach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9a33aff0-6db6-40f6-8dd2-4ba49a9bc30b tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a" acquired by "attach_volume" :: waited 0.067s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9a33aff0-6db6-40f6-8dd2-4ba49a9bc30b tempest-VolumesActionsTest-1179039627 None] Attaching volume 724827cf-9909-486d-b110-0741b9e7614a to instance 0a5bab28-b703-43e3-8c49-aa66cb8de556 at mountpoint /dev/vdb on host None. Jul 01 06:56:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9a33aff0-6db6-40f6-8dd2-4ba49a9bc30b tempest-VolumesActionsTest-1179039627 None] Attach volume completed successfully. Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9a33aff0-6db6-40f6-8dd2-4ba49a9bc30b tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a" released by "attach_volume" :: held 0.207s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Flow 'volume_create_manager' (72bf793b-5595-453b-96c0-201b3c24e38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c44cee-212b-4c20-a287-3c4c5328f229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c44cee-212b-4c20-a287-3c4c5328f229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e9d814-53f2-408c-8313-2c16d9deac66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3736e7682374b6b88d146f518602fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:13Z,use_quota=True,user_id='394d58bb84c84ea0ba099123fc1d14c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1491c32-cc2b-40bd-905d-0a208acf26ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:12 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1491c32-cc2b-40bd-905d-0a208acf26ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441d66b5-6007-40dd-8887-cf268a740105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441d66b5-6007-40dd-8887-cf268a740105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e9d814-53f2-408c-8313-2c16d9deac66', 'volume_name': 'volume-e0e9d814-53f2-408c-8313-2c16d9deac66', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f1fcde-c455-451d-ad81-9ae3aab2d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f1fcde-c455-451d-ad81-9ae3aab2d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d36672-ab0f-4808-afdd-b345c554a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Volume e0e9d814-53f2-408c-8313-2c16d9deac66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e9d814-53f2-408c-8313-2c16d9deac66', 'volume_size': 1} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" returned: 0 in 1.035s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] <== create_volume: return (3098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.103s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.177s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-301299196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb0e965-1e36-4d57-88c9-d9ad07e9651b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23994ed069814d09a7434ca02bd6e353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:08Z,use_quota=True,user_id='e5c2f329e60a4075a27a86a0f1c76c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Creating volume cdb0e965-1e36-4d57-88c9-d9ad07e9651b {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:56:12 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dd6adc-02c2-4098-aaec-79c9acba56a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda2839-5837-4d18-bd84-728f82f213c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:12 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b 1073741824 Jul 01 06:56:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Volume volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 (7a4e46f4-d01f-420e-a66f-2318f6fd4ae3): created successfully Jul 01 06:56:12 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda2839-5837-4d18-bd84-728f82f213c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Flow 'volume_create_manager' (02c54417-076d-46b7-85e1-2a9e4f98917d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-77110ac4-f41f-406f-b564-ddc3cd43c439 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Created volume successfully. Jul 01 06:56:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a7db2e0b-698f-4cca-9463-58d7a1cfb4ad tempest-VolumesActionsTest-1179039627 None] Acquiring lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-detach_volume" by "detach_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a7db2e0b-698f-4cca-9463-58d7a1cfb4ad tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a7db2e0b-698f-4cca-9463-58d7a1cfb4ad tempest-VolumesActionsTest-1179039627 None] Detaching volume 724827cf-9909-486d-b110-0741b9e7614a from instance 0a5bab28-b703-43e3-8c49-aa66cb8de556. Jul 01 06:56:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a7db2e0b-698f-4cca-9463-58d7a1cfb4ad tempest-VolumesActionsTest-1179039627 None] Detach volume completed successfully. Jul 01 06:56:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-a7db2e0b-698f-4cca-9463-58d7a1cfb4ad tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:13 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b 1073741824" returned: 0 in 1.246s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:14 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b Jul 01 06:56:14 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:14 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" returned: 0 in 0.746s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e9d814-53f2-408c-8313-2c16d9deac66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3736e7682374b6b88d146f518602fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:13Z,use_quota=True,user_id='394d58bb84c84ea0ba099123fc1d14c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Creating volume e0e9d814-53f2-408c-8313-2c16d9deac66 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:56:14 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:14 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 1073741824 Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b116fbab-cd71-4dff-a89e-7b4c1b69ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:14 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e698d17-70e5-48fa-a007-beb97700ed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:14 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Volume volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b (cdb0e965-1e36-4d57-88c9-d9ad07e9651b): created successfully Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e698d17-70e5-48fa-a007-beb97700ed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:14 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Flow 'volume_create_manager' (39c7791c-2f60-49ff-87c4-680df3bab12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f6da3a6d-e021-4c04-9e76-cf29a9651ebe tempest-TestMinimumBasicScenario-1944201612 None] Created volume successfully. Jul 01 06:56:15 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 1073741824" returned: 0 in 1.213s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:16 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 Jul 01 06:56:16 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:16 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d36672-ab0f-4808-afdd-b345c554a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e9d814-53f2-408c-8313-2c16d9deac66', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a42c03-1b45-4405-aeb5-e7c670534bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:16 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Volume volume-e0e9d814-53f2-408c-8313-2c16d9deac66 (e0e9d814-53f2-408c-8313-2c16d9deac66): created successfully Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a42c03-1b45-4405-aeb5-e7c670534bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Flow 'volume_create_manager' (72bf793b-5595-453b-96c0-201b3c24e38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-eb896e3a-d66d-42db-955a-200d8854b66c tempest-CinderUnicodeTest-648814500 None] Created volume successfully. Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Flow 'volume_create_manager' (4ad90289-06b5-4ce7-9af2-a34209df0d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2795db52-a09a-47e9-8ab6-309df6448a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2795db52-a09a-47e9-8ab6-309df6448a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1570933901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bbf706-d8e8-49b2-88c7-07410297a24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3736e7682374b6b88d146f518602fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:17Z,use_quota=True,user_id='394d58bb84c84ea0ba099123fc1d14c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b53a45-f761-43b8-b3b2-3a5fdab174f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b53a45-f761-43b8-b3b2-3a5fdab174f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254a3a0d-07e5-4552-9bde-553a3f3be41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254a3a0d-07e5-4552-9bde-553a3f3be41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bbf706-d8e8-49b2-88c7-07410297a24e', 'volume_name': 'volume-96bbf706-d8e8-49b2-88c7-07410297a24e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff6a2dc-fdb2-451c-aa4a-2885e5644433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff6a2dc-fdb2-451c-aa4a-2885e5644433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a0d937-c304-4365-903a-a7b3be5dea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Volume 96bbf706-d8e8-49b2-88c7-07410297a24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bbf706-d8e8-49b2-88c7-07410297a24e', 'volume_size': 1} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:56:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1570933901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bbf706-d8e8-49b2-88c7-07410297a24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3736e7682374b6b88d146f518602fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:56:17Z,use_quota=True,user_id='394d58bb84c84ea0ba099123fc1d14c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Creating volume 96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:56:17 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:56:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:17 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e 1073741824 Jul 01 06:56:17 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:18 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e 1073741824" returned: 0 in 0.942s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:18 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e Jul 01 06:56:18 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=62,cinder:INSERT=23,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:INSERT=21,cinder:UPDATE=67,cinder:SELECT=62,cinder:DELETE=7 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:19 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e" returned: 0 in 0.809s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.225s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a0d937-c304-4365-903a-a7b3be5dea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bbf706-d8e8-49b2-88c7-07410297a24e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e249d2e8-5acf-4149-a037-6769e3d94a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc065851-8753-4a2c-98fd-ac688ce1f9f9]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Volume volume-96bbf706-d8e8-49b2-88c7-07410297a24e (96bbf706-d8e8-49b2-88c7-07410297a24e): created successfully Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e249d2e8-5acf-4149-a037-6769e3d94a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:56:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Flow 'volume_create_manager' (4ad90289-06b5-4ce7-9af2-a34209df0d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:56:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-74a14e44-1518-4415-b423-dd2f553de74e tempest-CinderUnicodeTest-648814500 None] Created volume successfully. Jul 01 06:56:19 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b Jul 01 06:56:19 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:20 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" returned: 0 in 0.976s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31642742-aa87-4bf4-9b28-8af7260d4d8d', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:56:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-d42f3018-4b69-4255-8c7d-bbd79897b0b8 req-03548d5d-39a8-4de4-b6a4-ab9ff1d7d31f tempest-TestMinimumBasicScenario-1944201612 None] attachment_update completed successfully. Jul 01 06:56:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Creating offline snapshot 8a63a332-57df-4b80-a0c5-27817051313d of volume 96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:56:21 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dded9c-04a1-4fd5-bf87-c7951be5d74e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:21 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e Jul 01 06:56:21 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:22 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e" returned: 0 in 0.883s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:22 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d 1G Jul 01 06:56:22 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:23 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d 1G" returned: 0 in 0.869s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bbf706-d8e8-49b2-88c7-07410297a24e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:23 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bbf706-d8e8-49b2-88c7-07410297a24e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d Jul 01 06:56:23 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:23 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bbf706-d8e8-49b2-88c7-07410297a24e -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d" returned: 0 in 0.730s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:23 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d is being set with open permissions: ugo+rw Jul 01 06:56:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:23 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d Jul 01 06:56:23 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:24 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d" returned: 0 in 0.686s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:24 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info Jul 01 06:56:24 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:25 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info" returned: 0 in 0.703s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:25 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info is being set with open permissions: ugo+rw Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:25 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info Jul 01 06:56:25 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:25 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.info" returned: 0 in 0.695s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.687s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.362s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7943b-bfce-4794-b4aa-76ed7caf592c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9375b95b-0c80-47b6-ad30-1d932b2dafe7 tempest-CinderUnicodeTest-648814500 None] Create snapshot completed successfully Jul 01 06:56:26 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:56:26 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:26 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:56:26 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-8a63a332-57df-4b80-a0c5-27817051313d-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-8a63a332-57df-4b80-a0c5-27817051313d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-quobyte-96bbf706-d8e8-49b2-88c7-07410297a24e" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-96bbf706-d8e8-49b2-88c7-07410297a24e" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-quobyte-8a63a332-57df-4b80-a0c5-27817051313d" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-8a63a332-57df-4b80-a0c5-27817051313d" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Deleting offline snapshot 8a63a332-57df-4b80-a0c5-27817051313d of volume 96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] snapshot_file for this snap is: volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dd7e0-c764-451c-9ca0-c21eeb524139]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:27 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d Jul 01 06:56:27 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:27 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 1.735s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd3ec0d-c256-43b4-8492-3ada43e5c62f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:27 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.454s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:56:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:56:28 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:56:28 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:28 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d" returned: 0 in 1.474s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bbf706-d8e8-49b2-88c7-07410297a24e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:56:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[739994cd-1208-4eb0-a475-d400350abf7c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:28 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e Jul 01 06:56:28 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:29 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 1.362s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.8788e4ea-1ef4-4dbf-85bd-f0e943ab011e9293s6yl.img {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:29 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.8788e4ea-1ef4-4dbf-85bd-f0e943ab011e9293s6yl.img Jul 01 06:56:29 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:30 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e" returned: 0 in 1.609s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:30 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d Jul 01 06:56:30 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:33 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d" returned: 0 in 3.111s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:33 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d Jul 01 06:56:33 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:36 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=5,cinder:SELECT=10,cinder:INSERT=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:56:36 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=4,cinder:DELETE=2,cinder:SELECT=7 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:56:36 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e.8a63a332-57df-4b80-a0c5-27817051313d" returned: 0 in 3.273s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-8a63a332-57df-4b80-a0c5-27817051313d" released by "_delete_snapshot" :: held 9.862s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-96bbf706-d8e8-49b2-88c7-07410297a24e" released by "delete_snapshot" :: held 9.945s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:37 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Created reservations ['26be9cba-63e7-457d-806e-5dfa743bc8e6', '5deae0f1-d502-4a27-802b-fb34fd40a4c0', 'f5a03c0b-9d93-4c92-8fd9-27495ee0c7c7', '8ab05f53-0d72-4736-aa5f-676c05ee35a6'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:56:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Delete snapshot completed successfully. Jul 01 06:56:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4ea30958-6fff-461b-a243-cc1cebab7482 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-8a63a332-57df-4b80-a0c5-27817051313d-delete_snapshot" released by "delete_snapshot" :: held 10.737s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:37 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.8788e4ea-1ef4-4dbf-85bd-f0e943ab011e9293s6yl.img" returned: 0 in 8.693s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:37 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[456ad914-cc1e-4fd8-9b36-83e9e4789a10]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:38 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:56:38 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-96bbf706-d8e8-49b2-88c7-07410297a24e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-96bbf706-d8e8-49b2-88c7-07410297a24e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-quobyte-96bbf706-d8e8-49b2-88c7-07410297a24e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-96bbf706-d8e8-49b2-88c7-07410297a24e" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac65f58f-abeb-412d-811e-45c5792cefcf]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:38 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e Jul 01 06:56:38 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:39 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 1.274s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:39 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.8788e4ea-1ef4-4dbf-85bd-f0e943ab011e9293s6yl.img {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:56:39 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Converted 1024.00 MB image at 117.79 MB/s Jul 01 06:56:39 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] 8788e4ea-1ef4-4dbf-85bd-f0e943ab011e was raw, no need to convert to raw {{(pid=86219) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 01 06:56:39 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e" returned: 0 in 1.095s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:39 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e Jul 01 06:56:39 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:40 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-96bbf706-d8e8-49b2-88c7-07410297a24e" returned: 0 in 0.979s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-96bbf706-d8e8-49b2-88c7-07410297a24e" released by "delete_volume" :: held 2.171s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:40 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Created reservations ['38e1bf1f-512d-4e4b-9b94-cfabce74625f', '8d18a4d7-8f9b-47b2-bb39-ec3dc4eadbef', '432890f6-f074-4ebc-bc05-74f6610ca55d', '5bbb0511-feba-4f74-914f-08eb42dcecd9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:41 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:56:41 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-e0e9d814-53f2-408c-8313-2c16d9deac66-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-e0e9d814-53f2-408c-8313-2c16d9deac66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "cinder-quobyte-e0e9d814-53f2-408c-8313-2c16d9deac66" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-e0e9d814-53f2-408c-8313-2c16d9deac66" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b69c3a1-ed92-4757-b2da-3fbb77befefe]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:56:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:41 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 Jul 01 06:56:41 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:42 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.026s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:42 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:56:42 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Deleted volume successfully. Jul 01 06:56:42 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7fb91508-f63d-471b-b1c1-4d74eaec6937 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-96bbf706-d8e8-49b2-88c7-07410297a24e-delete_volume" released by "delete_volume" :: held 3.822s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:42 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66" returned: 0 in 1.131s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:42 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66 Jul 01 06:56:42 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:43 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e0e9d814-53f2-408c-8313-2c16d9deac66" returned: 0 in 0.845s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-quobyte-e0e9d814-53f2-408c-8313-2c16d9deac66" released by "delete_volume" :: held 2.039s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:43 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Created reservations ['1fdd1e18-9f55-4c02-94bb-67ee95975e52', '233410e1-229b-43bd-a584-273b361ad56e', 'ec0c46ee-3d42-4805-aa92-65dce0a59952', 'bcb70a8a-3479-49db-9b47-22583fa22755'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:56:44 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:56:44 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:56:44 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.828s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:56:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Deleted volume successfully. Jul 01 06:56:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-100a90bd-76db-48c9-9223-c5eb8a632535 tempest-CinderUnicodeTest-648814500 None] Lock "cinder-e0e9d814-53f2-408c-8313-2c16d9deac66-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:56:54 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:56:54 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:56:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.222s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Uploaded volume to glance image-id: 8788e4ea-1ef4-4dbf-85bd-f0e943ab011e. {{(pid=86219) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 01 06:57:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.037s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[006726d8-ab1d-42bb-b257-cab621cf2eeb]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-85997a0b-bea5-4e5b-ba88-df95e3d96cc7 tempest-VolumesActionsTest-1179039627 None] Copy volume to image completed successfully. Jul 01 06:57:02 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be Jul 01 06:57:02 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:03 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" returned: 0 in 0.798s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd10acb4-0589-4398-a6a9-934e7b8831ad', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:57:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-12041aee-106b-457e-a5df-6008e4392eef req-442a2610-fbf6-4d8a-88f3-4b354ebb8aa8 tempest-TestServerVolumeAttachmentScenario-1270479374 None] attachment_update completed successfully. Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f0041-f283-4964-bdd1-688d5ab6fe11]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:04 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:57:04 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:04 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 0.771s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f98781c-ae52-4580-b533-50b6beafe631]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:04 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:57:04 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:05 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 0.761s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:05 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img Jul 01 06:57:05 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:10 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img" returned: 0 in 4.697s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce5be30-4306-4eb1-b6b7-ebcb69328bdf]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:10 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:57:10 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:11 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 0.951s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:11 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a, size 1024.00 MB, duration 4.70 sec, destination /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:57:11 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Converted 1024.00 MB image at 217.94 MB/s Jul 01 06:57:11 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] 334fe3dc-4d7e-47ed-8ba1-081e7d7411bd was raw, converting to qcow2 {{(pid=86219) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 01 06:57:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a852cac4-70ef-45d9-848d-d3fd165afad0]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:11 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img Jul 01 06:57:11 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:12 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img" returned: 0 in 0.751s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:12 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img Jul 01 06:57:12 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:12 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img" returned: 1 in 0.723s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:57:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img /opt/stack/data/cinder/conversion/vol_upload_tp685ac1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:12 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img /opt/stack/data/cinder/conversion/vol_upload_tp685ac1 Jul 01 06:57:12 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:13 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img /opt/stack/data/cinder/conversion/vol_upload_tp685ac1" returned: 0 in 0.668s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:13 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Image conversion details: src /opt/stack/data/cinder/conversion/724827cf-9909-486d-b110-0741b9e7614a.temp_image.334fe3dc-4d7e-47ed-8ba1-081e7d7411bdn34h0c18.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tp685ac1 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:57:13 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 01 06:57:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a8fcee-5a6c-4f51-8fc8-61fea3c1769f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tp685ac1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:13 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tp685ac1 Jul 01 06:57:13 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:14 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tp685ac1" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.668s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:15 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Uploaded volume to glance image-id: 334fe3dc-4d7e-47ed-8ba1-081e7d7411bd. {{(pid=86219) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 01 06:57:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.265s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:15 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9a676-2fa0-4460-a34e-5ec14dbfd20b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-433d5989-e346-4778-a56d-66f6e6d2e39a tempest-VolumesActionsTest-1179039627 None] Copy volume to image completed successfully. Jul 01 06:57:15 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 Jul 01 06:57:15 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-e6b2f3dc-3488-4b71-b4d0-34276bbc3ef1 req-44992d7b-b9bf-4cac-b06e-acfd9e2c8786 tempest-TestMinimumBasicScenario-1944201612 None] Terminate volume connection completed successfully. Jul 01 06:57:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-e6b2f3dc-3488-4b71-b4d0-34276bbc3ef1 req-44992d7b-b9bf-4cac-b06e-acfd9e2c8786 tempest-TestMinimumBasicScenario-1944201612 None] Deleting attachment 31642742-aa87-4bf4-9b28-8af7260d4d8d. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:57:16 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" returned: 0 in 0.814s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:16 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81a528a6-3447-4d6a-9fc2-bea6126610d2', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:57:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-da83f7a5-791d-4059-b78d-dd2c0d5dd0f8 req-83b29e3b-7603-4095-a31d-6ce502c51950 tempest-TestServerVolumeAttachmentScenario-1270479374 None] attachment_update completed successfully. Jul 01 06:57:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "cinder-quobyte-724827cf-9909-486d-b110-0741b9e7614a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Lock "cinder-quobyte-724827cf-9909-486d-b110-0741b9e7614a" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[17881136-4c75-4586-bf12-87b904150347]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:17 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:57:17 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:18 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 0.794s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Acquiring lock "cinder-cdb0e965-1e36-4d57-88c9-d9ad07e9651b-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:18 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a Jul 01 06:57:18 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Lock "cinder-cdb0e965-1e36-4d57-88c9-d9ad07e9651b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Acquiring lock "cinder-quobyte-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Lock "cinder-quobyte-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" acquired by "delete_volume" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4ed91a-58a3-4cd2-934a-917fe9575ab2]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:18 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b Jul 01 06:57:18 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:19 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-724827cf-9909-486d-b110-0741b9e7614a" returned: 0 in 0.707s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Lock "cinder-quobyte-724827cf-9909-486d-b110-0741b9e7614a" released by "delete_volume" :: held 1.542s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Created reservations ['61d283aa-9442-478c-b6e0-bf9013bdda8d', '6ed01531-3a86-4a43-bd2d-4e72c780d57f', 'faf4fc2a-6017-45e0-a423-4826cb687158', '632ecac6-1274-4370-92e7-2ca48dcdc3d7'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:19 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:19 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:19 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" returned: 0 in 0.788s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:19 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b Jul 01 06:57:19 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:19 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Deleted volume successfully. Jul 01 06:57:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9f7eac66-c11b-4089-960e-99beed5e2c44 tempest-VolumesActionsTest-1179039627 None] Lock "cinder-724827cf-9909-486d-b110-0741b9e7614a-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:20 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" returned: 0 in 0.688s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Lock "cinder-quobyte-cdb0e965-1e36-4d57-88c9-d9ad07e9651b" released by "delete_volume" :: held 1.518s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Created reservations ['54707049-47ef-45ce-89b6-c0c5903308ca', '9e89982d-1b56-433c-a3da-c9d82fc4a399', 'cb1fbc26-c250-4668-a6ca-4b27b60938ea', '420f4604-86d5-4beb-9e32-e500dff9abb1'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:20 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:20 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:20 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Deleted volume successfully. Jul 01 06:57:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f4147615-733d-4d15-9781-d59395caefbb tempest-TestMinimumBasicScenario-1944201612 None] Lock "cinder-cdb0e965-1e36-4d57-88c9-d9ad07e9651b-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-91299e8a-2320-4a9f-865a-aaa2b50fe9d0 req-e8f95aa5-91e4-488d-b192-32b6bc958445 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Terminate volume connection completed successfully. Jul 01 06:57:22 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-91299e8a-2320-4a9f-865a-aaa2b50fe9d0 req-e8f95aa5-91e4-488d-b192-32b6bc958445 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Deleting attachment 81a528a6-3447-4d6a-9fc2-bea6126610d2. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:57:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-e0b9125d-3d5f-468a-86ae-8a959d0a99e5 req-cc208cc6-8b58-4e01-9a03-55b578f939d0 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Terminate volume connection completed successfully. Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-e0b9125d-3d5f-468a-86ae-8a959d0a99e5 req-cc208cc6-8b58-4e01-9a03-55b578f939d0 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Deleting attachment bd10acb4-0589-4398-a6a9-934e7b8831ad. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:26 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:26 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Flow 'volume_create_manager' (b7363e2c-6e9a-48f2-a650-db40a14d1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1d4c3a-0f9b-4fa3-9a24-dc8927d93ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1d4c3a-0f9b-4fa3-9a24-dc8927d93ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-400607026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8468564-79c4-4d77-b259-bdc93cd2590f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22d4ef8ce8947fc8591c1b776842fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:27Z,use_quota=True,user_id='3573e7d6d7894616b5338e85a02404d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a50cf0-1233-49f1-ad47-f8d3464bc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a50cf0-1233-49f1-ad47-f8d3464bc932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73111dd8-f140-4874-b2a1-e064a99ff6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73111dd8-f140-4874-b2a1-e064a99ff6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8468564-79c4-4d77-b259-bdc93cd2590f', 'volume_name': 'volume-a8468564-79c4-4d77-b259-bdc93cd2590f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992ef240-fc0d-4697-aead-2f283be0257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992ef240-fc0d-4697-aead-2f283be0257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ece116-c956-49b0-a5c0-ddd67d28e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:26 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Volume a8468564-79c4-4d77-b259-bdc93cd2590f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8468564-79c4-4d77-b259-bdc93cd2590f', 'volume_size': 1} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-400607026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8468564-79c4-4d77-b259-bdc93cd2590f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22d4ef8ce8947fc8591c1b776842fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:27Z,use_quota=True,user_id='3573e7d6d7894616b5338e85a02404d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Creating volume a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:57:26 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:57:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:26 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f 1073741824 Jul 01 06:57:26 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:27 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.698s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:57:27 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f 1073741824" returned: 0 in 0.912s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:27 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:27 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:28 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 0.743s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ece116-c956-49b0-a5c0-ddd67d28e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8468564-79c4-4d77-b259-bdc93cd2590f', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954369e6-3594-4119-96f6-728d6be1684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:28 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Volume volume-a8468564-79c4-4d77-b259-bdc93cd2590f (a8468564-79c4-4d77-b259-bdc93cd2590f): created successfully Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954369e6-3594-4119-96f6-728d6be1684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Flow 'volume_create_manager' (b7363e2c-6e9a-48f2-a650-db40a14d1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:28 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-615a38fc-dc1e-48cc-beee-da55ca532ecc tempest-VolumesCloneTest-745379176 None] Created volume successfully. Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Flow 'volume_create_manager' (092d0bd7-5caf-4c20-ad1c-783384d2f741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb96fea-7b80-4620-b846-1c8745d0be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb96fea-7b80-4620-b846-1c8745d0be33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-549319196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244f4b7e-839e-4bf3-8269-ed3322ec3587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22d4ef8ce8947fc8591c1b776842fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a8468564-79c4-4d77-b259-bdc93cd2590f,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:29Z,use_quota=True,user_id='3573e7d6d7894616b5338e85a02404d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73a377e-df33-412e-9fa2-2455db4287c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73a377e-df33-412e-9fa2-2455db4287c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2494d693-3f18-4b25-bd06-ab8a74b9bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2494d693-3f18-4b25-bd06-ab8a74b9bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '244f4b7e-839e-4bf3-8269-ed3322ec3587', 'volume_name': 'volume-244f4b7e-839e-4bf3-8269-ed3322ec3587', 'volume_size': 2, 'source_volid': 'a8468564-79c4-4d77-b259-bdc93cd2590f', 'source_volstatus': 'available'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff61dd4-7509-4d73-a645-a06dae881bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff61dd4-7509-4d73-a645-a06dae881bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9fe65b-c1ba-4d36-9ab3-618b9a3fee7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:29 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Volume 244f4b7e-839e-4bf3-8269-ed3322ec3587: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-244f4b7e-839e-4bf3-8269-ed3322ec3587', 'volume_size': 2, 'source_volid': 'a8468564-79c4-4d77-b259-bdc93cd2590f', 'source_volstatus': 'available'} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:29 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Cloning volume a8468564-79c4-4d77-b259-bdc93cd2590f to volume 244f4b7e-839e-4bf3-8269-ed3322ec3587 Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Creating offline snapshot 9bed9ef3-485f-41dc-a907-f5dbbeba82d5 of volume a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a5bd0-53dc-448f-ad96-7f5d439eb4f6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:29 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:29 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:30 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 1.181s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:30 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 1G Jul 01 06:57:30 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:31 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 1G" returned: 0 in 1.149s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8468564-79c4-4d77-b259-bdc93cd2590f -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:31 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8468564-79c4-4d77-b259-bdc93cd2590f -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 Jul 01 06:57:31 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:32 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8468564-79c4-4d77-b259-bdc93cd2590f -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5" returned: 0 in 0.806s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:32 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 is being set with open permissions: ugo+rw Jul 01 06:57:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:32 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 Jul 01 06:57:32 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:33 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5" returned: 0 in 0.680s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:33 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info Jul 01 06:57:33 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:34 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info" returned: 0 in 0.714s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:34 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info is being set with open permissions: ugo+rw Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:34 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info Jul 01 06:57:34 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:34 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.info" returned: 0 in 0.678s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Acquiring lock "cinder-quobyte-244f4b7e-839e-4bf3-8269-ed3322ec3587" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-244f4b7e-839e-4bf3-8269-ed3322ec3587" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] snapshot: 9bed9ef3-485f-41dc-a907-f5dbbeba82d5, volume: 244f4b7e-839e-4bf3-8269-ed3322ec3587, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[04271d92-b14f-4a85-820b-b2efbc85b1cf]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:35 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 Jul 01 06:57:35 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:36 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5" returned: 0 in 1.053s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8468564-79c4-4d77-b259-bdc93cd2590f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74fdf48-22df-4137-9725-feb5c068605d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:36 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:36 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "cinder-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "cinder-quobyte-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-quobyte-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e1711-0d1b-459e-bb98-56b24306ba0f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:36 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 Jul 01 06:57:36 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:37 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 1.023s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:37 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:57:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:37 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 Jul 01 06:57:37 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:37 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:37 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3 Jul 01 06:57:37 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:38 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" returned: 0 in 1.200s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-quobyte-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3" released by "delete_volume" :: held 2.164s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:38 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Created reservations ['9fb33b9e-1d8e-42b4-be58-284a87d6ecbd', '75e5bbf2-2020-463f-95fa-2f8955880c33', '14bee4f8-2d39-47a7-819c-bd1119482880', 'f3dd7d66-5b07-4021-beef-928e030c624c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:57:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:39 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:39 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:39 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:40 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.169s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Deleted volume successfully. Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "cinder-1db1031d-4a98-48eb-8c85-7d0ef57fb1be-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8bbc535d-3360-4c32-8170-e117660317c3 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-7a4e46f4-d01f-420e-a66f-2318f6fd4ae3-delete_volume" released by "delete_volume" :: held 3.905s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-1db1031d-4a98-48eb-8c85-7d0ef57fb1be-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "cinder-quobyte-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-quobyte-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" acquired by "delete_volume" :: waited 0.041s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae7c31-77c5-4738-ae39-ff7f5d865d08]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:41 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be Jul 01 06:57:41 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:43 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" returned: 0 in 2.254s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:43 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be Jul 01 06:57:43 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:43 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587" returned: 0 in 6.022s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14c0b0e-3ae2-4f57-8a02-75fb5068cdae]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:43 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:43 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (e8ac3533-9311-41dc-9ea8-2a887fbcb633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc21eba-7226-4477-8252-3419c07ce70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc21eba-7226-4477-8252-3419c07ce70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893991129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa6d53a-dad5-46b8-956b-8c4e262e3168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:43Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a73a9ef-3154-4c95-b084-3b1bc2359cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a73a9ef-3154-4c95-b084-3b1bc2359cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3e438d-3dd8-4960-92fe-4a275500982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3e438d-3dd8-4960-92fe-4a275500982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa6d53a-dad5-46b8-956b-8c4e262e3168', 'volume_name': 'volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4dddfb7-7b4e-4bc5-ba4d-42d19fd38525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4dddfb7-7b4e-4bc5-ba4d-42d19fd38525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c23b3d-8173-4088-a42a-4556368a4183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:43 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Volume 0aa6d53a-dad5-46b8-956b-8c4e262e3168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168', 'volume_size': 1} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:43 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" returned: 0 in 0.823s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-quobyte-1db1031d-4a98-48eb-8c85-7d0ef57fb1be" released by "delete_volume" :: held 3.204s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (565c1e2d-b7c7-49fb-af9f-b1f8a47f3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36c9caf-86f9-4e8c-b09f-136b968ab3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36c9caf-86f9-4e8c-b09f-136b968ab3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154393540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e894459e-610f-478b-b490-ac568216d7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:44Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c6b0ff-c71b-439b-98ec-e4c03d094556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c6b0ff-c71b-439b-98ec-e4c03d094556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9965e2-9542-47c5-9cea-3bddc85e663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9965e2-9542-47c5-9cea-3bddc85e663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e894459e-610f-478b-b490-ac568216d7c7', 'volume_name': 'volume-e894459e-610f-478b-b490-ac568216d7c7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e1c56-a144-45de-8376-fb9aabd616cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e1c56-a144-45de-8376-fb9aabd616cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cc6b2d-08c6-468b-8bfd-4fa6fd86ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Volume e894459e-610f-478b-b490-ac568216d7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e894459e-610f-478b-b490-ac568216d7c7', 'volume_size': 1} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Created reservations ['c2e6b463-9c38-47dd-8880-909cbd870c37', '105e750b-b9cd-4006-96be-8f77223ae803', '2b227b89-aa63-46a1-a7cd-2df56d91651d', '0c7b29e7-435a-42a0-920d-8db9a21d7347'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:44 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:44 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (f5fe1054-a4b7-4f59-a703-3863671c1c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:44 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8eb73ce-4e7d-400c-a50f-a6b28613acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 1.364s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:57:44 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Converted 1024.00 MB image at 170.01 MB/s Jul 01 06:57:44 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 is being set with open permissions: ugo+rw Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8eb73ce-4e7d-400c-a50f-a6b28613acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311900503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed5bb36-e65c-494e-b3d7-f40b8353209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:44Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7ee59f-3a6f-4fc1-8e5f-697026bab9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 Jul 01 06:57:44 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7ee59f-3a6f-4fc1-8e5f-697026bab9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62cb214-da20-459f-88ec-bd4aab1ec8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62cb214-da20-459f-88ec-bd4aab1ec8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed5bb36-e65c-494e-b3d7-f40b8353209e', 'volume_name': 'volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bfa8e0-5580-4265-95f7-0401322aa33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bfa8e0-5580-4265-95f7-0401322aa33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78adf3d4-3859-49fd-b60a-bc80c96ea804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Volume 7ed5bb36-e65c-494e-b3d7-f40b8353209e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e', 'volume_size': 1} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (1e4b6d9b-0fee-4311-a5f3-3656993332e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8bc96a-8529-4f8b-bd88-62db44d11132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8bc96a-8529-4f8b-bd88-62db44d11132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166516539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28844905-075c-4526-9f94-28157c290441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:45Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158758fe-aca1-4a8b-b841-143598abe90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158758fe-aca1-4a8b-b841-143598abe90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e4b9e9-215e-4cd6-b297-5df3d0d4a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e4b9e9-215e-4cd6-b297-5df3d0d4a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28844905-075c-4526-9f94-28157c290441', 'volume_name': 'volume-28844905-075c-4526-9f94-28157c290441', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03579f34-4660-49ed-98e7-4bbc7fc347f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03579f34-4660-49ed-98e7-4bbc7fc347f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278e417d-50ff-4a2d-88be-102b5f3ebedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Volume 28844905-075c-4526-9f94-28157c290441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28844905-075c-4526-9f94-28157c290441', 'volume_size': 1} Jul 01 06:57:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:45 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.905s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Deleted volume successfully. Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9da5b645-d340-4982-b695-81c64aada360 tempest-TestServerVolumeAttachmentScenario-1270479374 None] Lock "cinder-1db1031d-4a98-48eb-8c85-7d0ef57fb1be-delete_volume" released by "delete_volume" :: held 4.623s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (9977855c-97e6-447d-a3ea-4445ae884b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510c9ace-3c15-4c1a-b0c3-b9f069f8ea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:45 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587" returned: 0 in 0.848s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510c9ace-3c15-4c1a-b0c3-b9f069f8ea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411787982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47de802e-19bf-4894-976f-b5934b4c424d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:45Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62412b1e-caa9-4e5b-b71e-9901fe288acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62412b1e-caa9-4e5b-b71e-9901fe288acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ffcbf1-4e77-48e5-9cc5-67866f916143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ffcbf1-4e77-48e5-9cc5-67866f916143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47de802e-19bf-4894-976f-b5934b4c424d', 'volume_name': 'volume-47de802e-19bf-4894-976f-b5934b4c424d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee30313-f331-49dd-b739-6687cdf9e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee30313-f331-49dd-b739-6687cdf9e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb48373-b38c-41fc-9605-c31faedb3daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:45 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Volume 47de802e-19bf-4894-976f-b5934b4c424d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47de802e-19bf-4894-976f-b5934b4c424d', 'volume_size': 1} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-244f4b7e-839e-4bf3-8269-ed3322ec3587" released by "_copy_volume_from_snapshot" :: held 10.451s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Acquiring lock "cinder-quobyte-9bed9ef3-485f-41dc-a907-f5dbbeba82d5" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-9bed9ef3-485f-41dc-a907-f5dbbeba82d5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Deleting offline snapshot 9bed9ef3-485f-41dc-a907-f5dbbeba82d5 of volume a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] snapshot_file for this snap is: volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb65471-e7a3-4c4a-b80f-fe6e1ae4aaa4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:45 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 Jul 01 06:57:45 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:46 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8468564-79c4-4d77-b259-bdc93cd2590f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:57:46 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d28713-a6ee-498d-83be-2ba28076f39b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:46 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:46 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:47 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 0.818s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:47 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 Jul 01 06:57:47 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:47 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5" returned: 0 in 0.866s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:47 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5 Jul 01 06:57:47 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:48 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f.9bed9ef3-485f-41dc-a907-f5dbbeba82d5" returned: 0 in 0.664s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-9bed9ef3-485f-41dc-a907-f5dbbeba82d5" released by "_delete_snapshot" :: held 3.248s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.232s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.060s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893991129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa6d53a-dad5-46b8-956b-8c4e262e3168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:43Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Creating volume 0aa6d53a-dad5-46b8-956b-8c4e262e3168 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:57:48 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:48 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 1073741824 Jul 01 06:57:48 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9fe65b-c1ba-4d36-9ab3-618b9a3fee7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244f4b7e-839e-4bf3-8269-ed3322ec3587', 'volume_size': 2, 'source_volid': 'a8468564-79c4-4d77-b259-bdc93cd2590f', 'source_volstatus': 'available'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8abd8c1-45cf-49da-9e60-f113f92fb939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Volume volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 (244f4b7e-839e-4bf3-8269-ed3322ec3587): created successfully Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8abd8c1-45cf-49da-9e60-f113f92fb939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Flow 'volume_create_manager' (092d0bd7-5caf-4c20-ad1c-783384d2f741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e74c8651-67a5-40fe-b727-4d2e7fd10758 tempest-VolumesCloneTest-745379176 None] Created volume successfully. Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Acquiring lock "cinder-244f4b7e-839e-4bf3-8269-ed3322ec3587-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Lock "cinder-244f4b7e-839e-4bf3-8269-ed3322ec3587-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Acquiring lock "cinder-quobyte-244f4b7e-839e-4bf3-8269-ed3322ec3587" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-244f4b7e-839e-4bf3-8269-ed3322ec3587" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8dab40-ad01-4891-b94f-537b23633157]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:49 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 Jul 01 06:57:49 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:49 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 1073741824" returned: 0 in 0.922s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:49 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 Jul 01 06:57:49 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:50 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587" returned: 0 in 0.849s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:50 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587 Jul 01 06:57:50 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:50 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168" returned: 0 in 0.707s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.322s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154393540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e894459e-610f-478b-b490-ac568216d7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:44Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Creating volume e894459e-610f-478b-b490-ac568216d7c7 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:57:50 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:50 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 1073741824 Jul 01 06:57:50 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c23b3d-8173-4088-a42a-4556368a4183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada4cb2-d124-477a-864a-2cfe2f565658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:50 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Volume volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 (0aa6d53a-dad5-46b8-956b-8c4e262e3168): created successfully Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada4cb2-d124-477a-864a-2cfe2f565658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (e8ac3533-9311-41dc-9ea8-2a887fbcb633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:50 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8f9ae472-df82-4da2-a117-5a62e0d3d41d tempest-CreateVolumesFromImageTest-1670832260 None] Created volume successfully. Jul 01 06:57:50 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-244f4b7e-839e-4bf3-8269-ed3322ec3587" returned: 0 in 0.772s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-244f4b7e-839e-4bf3-8269-ed3322ec3587" released by "delete_volume" :: held 1.669s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Created reservations ['fd512d0c-961b-4bfd-89b0-f3a73cf58599', '3fb49b06-043d-482b-8106-3c4b37a2d85d', 'd78ecc51-9d38-4da2-8427-975899351456', '01a1db66-e7f1-472a-be7a-78817a5ee7ec'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:51 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:51 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:51 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 1073741824" returned: 0 in 0.987s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:51 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 Jul 01 06:57:51 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Acquiring lock "cinder-a8468564-79c4-4d77-b259-bdc93cd2590f-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Lock "cinder-a8468564-79c4-4d77-b259-bdc93cd2590f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Acquiring lock "cinder-quobyte-a8468564-79c4-4d77-b259-bdc93cd2590f" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-a8468564-79c4-4d77-b259-bdc93cd2590f" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab7709-ffc8-46fe-8e53-b7d97ef6b3e6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:51 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:51 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:52 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.989s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Deleted volume successfully. Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0baa5581-0aef-4d17-ae68-4cc87ac11a13 tempest-VolumesCloneTest-745379176 None] Lock "cinder-244f4b7e-839e-4bf3-8269-ed3322ec3587-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:52 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7" returned: 0 in 0.950s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.861s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311900503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed5bb36-e65c-494e-b3d7-f40b8353209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:44Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Creating volume 7ed5bb36-e65c-494e-b3d7-f40b8353209e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:57:52 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cc6b2d-08c6-468b-8bfd-4fa6fd86ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e894459e-610f-478b-b490-ac568216d7c7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:52 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e 1073741824 Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d51649-8edb-45e2-97e8-d342291993f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:52 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:52 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Volume volume-e894459e-610f-478b-b490-ac568216d7c7 (e894459e-610f-478b-b490-ac568216d7c7): created successfully Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d51649-8edb-45e2-97e8-d342291993f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (565c1e2d-b7c7-49fb-af9f-b1f8a47f3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:52 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-65fc308d-c913-4846-b83e-97f75ba3f035 tempest-CreateVolumesFromImageTest-1670832260 None] Created volume successfully. Jul 01 06:57:52 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 1.000s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:52 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f Jul 01 06:57:52 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:53 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e 1073741824" returned: 0 in 0.998s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:53 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e Jul 01 06:57:53 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:53 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a8468564-79c4-4d77-b259-bdc93cd2590f" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Lock "cinder-quobyte-a8468564-79c4-4d77-b259-bdc93cd2590f" released by "delete_volume" :: held 1.884s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Created reservations ['7016eb9b-f036-4005-97fc-f65eab32a5e7', '597192a8-5c2d-4137-9906-9b616e13c3e2', 'e918a035-f53c-49dd-b625-32b0244468b3', '001d227e-3394-48d2-a6ed-5dab60065e3a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:53 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:57:53 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:54 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.296s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166516539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28844905-075c-4526-9f94-28157c290441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:45Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Creating volume 28844905-075c-4526-9f94-28157c290441 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:57:54 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:54 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 1073741824 Jul 01 06:57:54 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78adf3d4-3859-49fd-b60a-bc80c96ea804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cfe40c-60f2-4f48-acf7-3b16485b13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=67,cinder:UPDATE=64,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:57:54 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Volume volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e (7ed5bb36-e65c-494e-b3d7-f40b8353209e): created successfully Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cfe40c-60f2-4f48-acf7-3b16485b13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (f5fe1054-a4b7-4f59-a703-3863671c1c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2be59e05-c3c4-4f10-b1ec-1a267642a75c tempest-CreateVolumesFromImageTest-1670832260 None] Created volume successfully. Jul 01 06:57:54 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.806s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:57:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Deleted volume successfully. Jul 01 06:57:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ae07b43d-7892-4fb4-ac3f-9ea880fe1386 tempest-VolumesCloneTest-745379176 None] Lock "cinder-a8468564-79c4-4d77-b259-bdc93cd2590f-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:57:55 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 1073741824" returned: 0 in 1.038s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:55 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=57,cinder:UPDATE=75,cinder:INSERT=14,cinder:DELETE=7 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:57:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:55 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 Jul 01 06:57:55 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:56 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441" returned: 0 in 0.767s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.760s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411787982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47de802e-19bf-4894-976f-b5934b4c424d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2d774a1444c78ad266597856e32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:45Z,use_quota=True,user_id='d4f128a99ffc4b2a9836cf7b0857c88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Creating volume 47de802e-19bf-4894-976f-b5934b4c424d {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:57:56 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:56 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d 1073741824 Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278e417d-50ff-4a2d-88be-102b5f3ebedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28844905-075c-4526-9f94-28157c290441', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:56 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d64c0d-7664-4c9a-bda1-401977541726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Volume volume-28844905-075c-4526-9f94-28157c290441 (28844905-075c-4526-9f94-28157c290441): created successfully Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d64c0d-7664-4c9a-bda1-401977541726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (1e4b6d9b-0fee-4311-a5f3-3656993332e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1ef770b3-411a-4de4-b9d4-1c80ea89cc82 tempest-CreateVolumesFromImageTest-1670832260 None] Created volume successfully. Jul 01 06:57:57 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d 1073741824" returned: 0 in 1.015s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:57 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d Jul 01 06:57:57 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Flow 'volume_create_manager' (2feae954-7420-4b6d-b5ab-8fb782daad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbed421-9bbb-4639-89c6-f8afd8f6d42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:57 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d" returned: 0 in 0.741s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbed421-9bbb-4639-89c6-f8afd8f6d42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-888806531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83d3fdb-aead-491e-a99f-8deb7c12885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2735b471a2434786972317a1d6fb6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:58Z,use_quota=True,user_id='ef4cd6569fdd446fa6a0f1e6134c6a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097bb546-d74e-440a-a7aa-debab5440317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097bb546-d74e-440a-a7aa-debab5440317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b551eb4f-d8be-4030-bf1a-0b5b1b333cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb48373-b38c-41fc-9605-c31faedb3daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47de802e-19bf-4894-976f-b5934b4c424d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b716103-d197-4263-bb8a-eebfa8f63399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Volume volume-47de802e-19bf-4894-976f-b5934b4c424d (47de802e-19bf-4894-976f-b5934b4c424d): created successfully Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b716103-d197-4263-bb8a-eebfa8f63399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Flow 'volume_create_manager' (9977855c-97e6-447d-a3ea-4445ae884b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:57:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-bfc66f23-0fd8-47e3-b968-62c7da924067 tempest-CreateVolumesFromImageTest-1670832260 None] Created volume successfully. Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b551eb4f-d8be-4030-bf1a-0b5b1b333cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f83d3fdb-aead-491e-a99f-8deb7c12885e', 'volume_name': 'volume-f83d3fdb-aead-491e-a99f-8deb7c12885e', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb98bb2-9040-4040-b263-baea7d5eb51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb98bb2-9040-4040-b263-baea7d5eb51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c26831-65df-406e-9ba2-cc8deaea77f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:57:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Volume f83d3fdb-aead-491e-a99f-8deb7c12885e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f83d3fdb-aead-491e-a99f-8deb7c12885e', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Trying to clone f83d3fdb-aead-491e-a99f-8deb7c12885e from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 06:57:58 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Image download 20.69 MB at 20.69 MB/s Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-47de802e-19bf-4894-976f-b5934b4c424d-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-47de802e-19bf-4894-976f-b5934b4c424d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bea2462-8c82-49e3-bc1e-f7f2757aa589]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-quobyte-47de802e-19bf-4894-976f-b5934b4c424d" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-47de802e-19bf-4894-976f-b5934b4c424d" acquired by "delete_volume" :: waited 0.025s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a02ab0-cd00-470b-bf97-bee0bf9e2c21]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:58 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD Jul 01 06:57:58 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:58 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d Jul 01 06:57:58 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:59 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:59 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 is fetched for user ef4cd6569fdd446fa6a0f1e6134c6a35. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 06:57:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[288fbe16-1edb-49f2-a7d2-bf7e99f36676]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:57:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:59 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 01 06:57:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d" returned: 0 in 0.788s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:57:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:57:59 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d Jul 01 06:57:59 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:57:59 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD Jul 01 06:57:59 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:00 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-47de802e-19bf-4894-976f-b5934b4c424d" returned: 0 in 0.756s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-47de802e-19bf-4894-976f-b5934b4c424d" released by "delete_volume" :: held 1.596s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:00 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD" returned: 0 in 0.842s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-888806531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83d3fdb-aead-491e-a99f-8deb7c12885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2735b471a2434786972317a1d6fb6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:57:58Z,use_quota=True,user_id='ef4cd6569fdd446fa6a0f1e6134c6a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Creating volume f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:58:00 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:00 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 1073741824 Jul 01 06:58:00 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Created reservations ['4997907f-fc91-4a4d-b7c3-182997e83c9f', 'f0e37ff8-7270-4fcd-998f-15620d0c4234', '1d09b431-6f95-4a62-83f2-c24c833a3d87', '6348ac70-b83a-413d-b441-21b0def1f391'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:00 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:00 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-28844905-075c-4526-9f94-28157c290441-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-28844905-075c-4526-9f94-28157c290441-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-quobyte-28844905-075c-4526-9f94-28157c290441" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-28844905-075c-4526-9f94-28157c290441" acquired by "delete_volume" :: waited 0.048s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bfa696-1833-4933-b39f-e8dff81992b9]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:01 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 Jul 01 06:58:01 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:01 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.984s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Deleted volume successfully. Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-514423ec-68ef-4992-b7a3-011aaa9c2234 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-47de802e-19bf-4894-976f-b5934b4c424d-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:01 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 1073741824" returned: 0 in 1.211s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:01 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:01 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:02 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441" returned: 0 in 1.037s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:02 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441 Jul 01 06:58:02 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:02 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 0 in 0.849s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Attempting download of 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume f83d3fdb-aead-491e-a99f-8deb7c12885e. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a28a4e-7840-4853-92fc-aaf88ef6e342]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:02 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5 Jul 01 06:58:02 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:02 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-28844905-075c-4526-9f94-28157c290441" returned: 0 in 0.680s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-28844905-075c-4526-9f94-28157c290441" released by "delete_volume" :: held 1.788s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Created reservations ['bf7f84a4-0a96-4dc1-b707-296a47d89ce5', 'ff831450-c8ab-46bb-9ad5-433728591516', 'ec2d0f73-ef06-42de-8d63-bc4b217e78d8', 'e76f9083-62fe-43d1-b08d-5335d1125362'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:03 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:03 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-7ed5bb36-e65c-494e-b3d7-f40b8353209e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:03 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5" returned: 0 in 0.865s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-7ed5bb36-e65c-494e-b3d7-f40b8353209e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-quobyte-7ed5bb36-e65c-494e-b3d7-f40b8353209e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-7ed5bb36-e65c-494e-b3d7-f40b8353209e" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[265494e5-8369-4db4-b40f-cb7b1f76bc51]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:03 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5 Jul 01 06:58:03 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:03 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e Jul 01 06:58:03 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:04 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.888s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:04 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Deleted volume successfully. Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-791dcec9-c742-4a9d-bfce-bb55af3b9d9e tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-28844905-075c-4526-9f94-28157c290441-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:04 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5" returned: 1 in 0.931s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_xt11q8r5' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[679df665-3841-48c2-8569-6b5467b0ee6b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:04 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD Jul 01 06:58:04 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:04 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e" returned: 0 in 1.007s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:04 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e Jul 01 06:58:04 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:05 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 was qcow2, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:05 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:05 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:05 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7ed5bb36-e65c-494e-b3d7-f40b8353209e" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-7ed5bb36-e65c-494e-b3d7-f40b8353209e" released by "delete_volume" :: held 1.793s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Created reservations ['388a75ff-8912-4bcf-9c87-48b1c4116b13', '36a34223-d3d6-405b-b03b-ce9a92fd0d44', 'b6eb4bc5-f39c-4153-a7de-e8b00392b0f1', '1cfcb7e1-30d0-44b4-8f21-71f8856b5a74'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:05 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:05 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-e894459e-610f-478b-b490-ac568216d7c7-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-e894459e-610f-478b-b490-ac568216d7c7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-quobyte-e894459e-610f-478b-b490-ac568216d7c7" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-e894459e-610f-478b-b490-ac568216d7c7" acquired by "delete_volume" :: waited 0.040s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3b57f8-799a-41ac-96c6-e8bab20df8fe]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:06 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 Jul 01 06:58:06 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:06 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.853s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:06 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Deleted volume successfully. Jul 01 06:58:06 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-082ffa34-dedb-4271-b804-006debe6612c tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-7ed5bb36-e65c-494e-b3d7-f40b8353209e-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:06 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7" returned: 0 in 0.858s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:06 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7 Jul 01 06:58:06 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:07 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-e894459e-610f-478b-b490-ac568216d7c7" returned: 0 in 0.794s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-e894459e-610f-478b-b490-ac568216d7c7" released by "delete_volume" :: held 1.712s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Created reservations ['8dc64e24-089e-42bf-8e14-85669e583284', '01c8ed70-2802-4e52-b1f5-a444f0123687', 'dab23bd8-21c7-4c13-b71d-766653a6eda5', 'dedbdf2a-5282-47e1-a196-83644a322001'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:07 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 0 in 2.498s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_0xg6e0d1devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:58:07 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Converted 112.00 MB image at 44.82 MB/s Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:07 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 1G Jul 01 06:58:07 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:07 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:07 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-0aa6d53a-dad5-46b8-956b-8c4e262e3168-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-0aa6d53a-dad5-46b8-956b-8c4e262e3168-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "cinder-quobyte-0aa6d53a-dad5-46b8-956b-8c4e262e3168" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-0aa6d53a-dad5-46b8-956b-8c4e262e3168" acquired by "delete_volume" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[80459f73-4353-4f31-9a3b-5d396dbe138c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:08 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 Jul 01 06:58:08 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:08 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Deleted volume successfully. Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-935120d1-edc5-424e-8559-5fac64afbeb1 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-e894459e-610f-478b-b490-ac568216d7c7-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:08 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 1G" returned: 0 in 0.885s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b5413-5b90-4ff6-a3f2-0134e179c7bc]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:08 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:08 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:09 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168" returned: 0 in 0.913s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:09 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168 Jul 01 06:58:09 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:09 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 0 in 0.892s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:09 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:09 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:09 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0aa6d53a-dad5-46b8-956b-8c4e262e3168" returned: 0 in 0.718s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-quobyte-0aa6d53a-dad5-46b8-956b-8c4e262e3168" released by "delete_volume" :: held 1.701s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Created reservations ['5f71a289-695c-428a-955d-a77ddce9f79c', 'f8e7aad5-3941-4af5-bf4f-8664c258abd0', '761df02d-7966-44ae-a8a3-5cd2331294a9', '2b5f6575-b012-4c72-b443-79e26365c213'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:10 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:10 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:10 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 1 in 0.897s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Downloaded image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume f83d3fdb-aead-491e-a99f-8deb7c12885e successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 for user ef4cd6569fdd446fa6a0f1e6134c6a35 is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Marking volume f83d3fdb-aead-491e-a99f-8deb7c12885e as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Copying metadata from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 to f83d3fdb-aead-491e-a99f-8deb7c12885e. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Creating volume glance metadata for volume f83d3fdb-aead-491e-a99f-8deb7c12885e backed by image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c26831-65df-406e-9ba2-cc8deaea77f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83d3fdb-aead-491e-a99f-8deb7c12885e', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c1cdcb-5109-4b79-a4f8-14baf923c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Volume volume-f83d3fdb-aead-491e-a99f-8deb7c12885e (f83d3fdb-aead-491e-a99f-8deb7c12885e): created successfully Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c1cdcb-5109-4b79-a4f8-14baf923c830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Flow 'volume_create_manager' (2feae954-7420-4b6d-b5ab-8fb782daad8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:10 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-de59ae2b-058c-4b34-a8b6-0996407afe46 tempest-VolumesExtendTest-1474280420 None] Created volume successfully. Jul 01 06:58:10 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.796s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:10 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:11 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Deleted volume successfully. Jul 01 06:58:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7f777642-6240-4a17-bfd6-7edf6395ebc0 tempest-CreateVolumesFromImageTest-1670832260 None] Lock "cinder-0aa6d53a-dad5-46b8-956b-8c4e262e3168-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[12408963-4591-40da-8b80-798f87a5f72f]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:11 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:11 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:12 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 0 in 0.817s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:12 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:12 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:12 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 1 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 2G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e 2G" returned: 0 in 0.068s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.750s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:13 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4b98e33e-d96f-4146-91e4-00948ab75aa3 tempest-VolumesExtendTest-1474280420 None] Extend volume completed successfully. Jul 01 06:58:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-f83d3fdb-aead-491e-a99f-8deb7c12885e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Lock "cinder-f83d3fdb-aead-491e-a99f-8deb7c12885e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-quobyte-f83d3fdb-aead-491e-a99f-8deb7c12885e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-f83d3fdb-aead-491e-a99f-8deb7c12885e" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d66d3b0-814d-4d8b-9681-89cf7cdc22e2]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:13 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:13 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:14 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 0 in 0.914s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:14 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:14 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:15 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 1 in 0.810s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:15 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e Jul 01 06:58:15 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:16 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f83d3fdb-aead-491e-a99f-8deb7c12885e" returned: 0 in 0.679s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-f83d3fdb-aead-491e-a99f-8deb7c12885e" released by "delete_volume" :: held 2.475s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Created reservations ['a823acc9-47dd-4825-95d8-1ba663b3b44e', 'af9157f2-f3ce-407b-a47c-0a90bb17de48', 'f8902ed1-fc85-48ee-90a6-7065602d2115', 'e94fdd19-31b7-408a-ac9f-3d4ca0c337e7'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:16 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:16 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:17 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.754s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Deleted volume successfully. Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-26378275-c1a9-4634-9879-96b0cdd2bb9f tempest-VolumesExtendTest-1474280420 None] Lock "cinder-f83d3fdb-aead-491e-a99f-8deb7c12885e-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Flow 'volume_create_manager' (7f856a86-507e-49e2-92c1-a7b82f33faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786a35f2-e179-4d5d-89ed-7b09d3a6a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786a35f2-e179-4d5d-89ed-7b09d3a6a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-25541855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097d41f4-9a69-4b79-a443-4eeee00fa637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2735b471a2434786972317a1d6fb6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:58:17Z,use_quota=True,user_id='ef4cd6569fdd446fa6a0f1e6134c6a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f554c7-e6a9-4618-a20b-fd24239049cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f554c7-e6a9-4618-a20b-fd24239049cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16d2d94-53c0-4b23-80bb-bdeae2e22f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16d2d94-53c0-4b23-80bb-bdeae2e22f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097d41f4-9a69-4b79-a443-4eeee00fa637', 'volume_name': 'volume-097d41f4-9a69-4b79-a443-4eeee00fa637', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc0bcda-ef7f-4a0a-9c52-d2726a30e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc0bcda-ef7f-4a0a-9c52-d2726a30e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eaab25-2312-4d99-a1e8-18759fb382e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Volume 097d41f4-9a69-4b79-a443-4eeee00fa637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097d41f4-9a69-4b79-a443-4eeee00fa637', 'volume_size': 1} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-25541855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097d41f4-9a69-4b79-a443-4eeee00fa637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2735b471a2434786972317a1d6fb6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:58:17Z,use_quota=True,user_id='ef4cd6569fdd446fa6a0f1e6134c6a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Creating volume 097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:58:17 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:58:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:17 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 1073741824 Jul 01 06:58:17 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:18 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 1073741824" returned: 0 in 0.893s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:18 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 Jul 01 06:58:18 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:19 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637" returned: 0 in 0.700s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eaab25-2312-4d99-a1e8-18759fb382e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097d41f4-9a69-4b79-a443-4eeee00fa637', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d0128-888a-4afa-81d3-782d18c4b421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Volume volume-097d41f4-9a69-4b79-a443-4eeee00fa637 (097d41f4-9a69-4b79-a443-4eeee00fa637): created successfully Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d0128-888a-4afa-81d3-782d18c4b421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Flow 'volume_create_manager' (7f856a86-507e-49e2-92c1-a7b82f33faad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-194efb75-7450-47e4-84d4-61e3c0c942b9 tempest-VolumesExtendTest-1474280420 None] Created volume successfully. Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Creating offline snapshot 9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 of volume 097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1f727-12fa-459f-9757-5e2e8f87386d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:19 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 Jul 01 06:58:19 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:20 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637" returned: 0 in 0.781s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:20 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 1G Jul 01 06:58:20 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:21 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 1G" returned: 0 in 0.906s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097d41f4-9a69-4b79-a443-4eeee00fa637 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:21 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097d41f4-9a69-4b79-a443-4eeee00fa637 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 Jul 01 06:58:21 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:22 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097d41f4-9a69-4b79-a443-4eeee00fa637 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" returned: 0 in 0.748s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:22 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 is being set with open permissions: ugo+rw Jul 01 06:58:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:22 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 Jul 01 06:58:22 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:22 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" returned: 0 in 0.648s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:22 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info Jul 01 06:58:22 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Flow 'volume_create_manager' (e3ea9ca2-ad03-4d67-87a0-12bc1adfe442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b755dff-5aa6-44ec-b447-7431a6416512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b755dff-5aa6-44ec-b447-7431a6416512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-133402026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53c3a36539f4289b0b2931beae1c167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:58:23Z,use_quota=True,user_id='4f87a62c4b874a738ef39ef89c309316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598ebe85-eb1d-47f2-abf6-ef50edfd64ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598ebe85-eb1d-47f2-abf6-ef50edfd64ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5ab3cc-1867-4b21-b81e-9dfd005f4987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5ab3cc-1867-4b21-b81e-9dfd005f4987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9', 'volume_name': 'volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af1c53a-9347-4dcf-ad16-c35926d50ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af1c53a-9347-4dcf-ad16-c35926d50ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02d9c17-ddf7-4e75-b45a-1ddb5067d8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:23 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Volume af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Trying to clone af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 06:58:23 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:23 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info is being set with open permissions: ugo+rw Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:23 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info Jul 01 06:58:23 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 06:58:23 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Image download 20.69 MB at 20.69 MB/s Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[78980cc4-0285-41cc-80f2-4447e4f12334]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:24 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD Jul 01 06:58:24 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:24 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.info" returned: 0 in 0.673s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.523s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:24 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c99d62d9-1aea-4d9d-bb08-aee5cd16a375 tempest-VolumesExtendTest-1474280420 None] Create snapshot completed successfully Jul 01 06:58:24 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:24 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 is fetched for user 4f87a62c4b874a738ef39ef89c309316. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 06:58:24 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca2965f-24fb-4ce8-8a76-6caa54c9bbf6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:24 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD Jul 01 06:58:24 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[53972cba-058f-460b-b39c-e0941471c2ca]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:25 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 Jul 01 06:58:25 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:25 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:25 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637" returned: 0 in 0.760s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 2G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 2G" returned: 0 in 0.118s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.921s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-133402026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53c3a36539f4289b0b2931beae1c167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:58:23Z,use_quota=True,user_id='4f87a62c4b874a738ef39ef89c309316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Creating volume af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:58:26 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:26 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 1073741824 Jul 01 06:58:26 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-db7c2458-9c31-4eb0-bac6-54b3dec1e87d tempest-VolumesExtendTest-1474280420 None] Extend volume completed successfully. Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-9a09c913-abf4-4da3-a0ac-8f3bdc5999d7-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Lock "cinder-9a09c913-abf4-4da3-a0ac-8f3bdc5999d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-quobyte-097d41f4-9a69-4b79-a443-4eeee00fa637" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-097d41f4-9a69-4b79-a443-4eeee00fa637" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-quobyte-9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Deleting offline snapshot 9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 of volume 097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] snapshot_file for this snap is: volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fec758-5d60-4b28-a18c-19a29153a0c2]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:26 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:26 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:26 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 Jul 01 06:58:26 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:26 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 1073741824" returned: 0 in 0.849s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:26 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:58:26 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:27 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.709s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:58:27 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" returned: 0 in 0.830s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-097d41f4-9a69-4b79-a443-4eeee00fa637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8467ed0e-2c0f-46ad-9b76-bbc2975bf728]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:27 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 Jul 01 06:58:27 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:27 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 0.655s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Attempting download of 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e15fb5-f1fc-4aee-bb86-07e6e0e2cc48]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:27 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa Jul 01 06:58:27 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:28 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637" returned: 0 in 0.766s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:28 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 Jul 01 06:58:28 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:28 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa" returned: 0 in 0.756s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:28 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa Jul 01 06:58:28 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:28 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" returned: 0 in 0.783s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:28 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7 Jul 01 06:58:28 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:29 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa" returned: 1 in 0.734s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_q02f6iqa' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc95a45-bb79-454d-90b0-2a837fc88ad0]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:29 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD Jul 01 06:58:29 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:29 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637.9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-9a09c913-abf4-4da3-a0ac-8f3bdc5999d7" released by "_delete_snapshot" :: held 3.165s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-097d41f4-9a69-4b79-a443-4eeee00fa637" released by "delete_snapshot" :: held 3.187s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Created reservations ['bad5e37c-6396-43ce-9808-6fce02a674bc', '24b43fd8-ff64-4369-9c19-fd5319212f5c', '3ee929e0-2741-45e3-b403-f9d608eaec41', 'be85674a-6791-4642-a29a-6ad9e5bc7226'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Delete snapshot completed successfully. Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-dbd75227-8a9b-4c60-bd29-e9e32e3faf35 tempest-VolumesExtendTest-1474280420 None] Lock "cinder-9a09c913-abf4-4da3-a0ac-8f3bdc5999d7-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:29 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 was qcow2, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 06:58:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:29 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:58:29 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-097d41f4-9a69-4b79-a443-4eeee00fa637-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Lock "cinder-097d41f4-9a69-4b79-a443-4eeee00fa637-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Acquiring lock "cinder-quobyte-097d41f4-9a69-4b79-a443-4eeee00fa637" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:58:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-097d41f4-9a69-4b79-a443-4eeee00fa637" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:58:30 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ad36b-db9e-4b4c-a919-144a01c33b41]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:30 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 Jul 01 06:58:30 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:31 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637" returned: 0 in 0.806s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:31 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637 Jul 01 06:58:31 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:31 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 1.884s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:31 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4507a0d3-aad2-4779-8b90-bdd1bccd3dd3_7zhajnwwdevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:58:31 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Converted 112.00 MB image at 59.40 MB/s Jul 01 06:58:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:31 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 1G Jul 01 06:58:31 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:32 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-097d41f4-9a69-4b79-a443-4eeee00fa637" returned: 0 in 0.659s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Lock "cinder-quobyte-097d41f4-9a69-4b79-a443-4eeee00fa637" released by "delete_volume" :: held 1.532s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Created reservations ['cddf996d-4ea4-417e-bf90-054156036030', '8b9b8b27-6381-409a-9352-a1cab75b4229', 'dc62b6e9-4302-4ef9-ab5e-824b5356686d', 'bb34f39e-3278-4bed-8e83-d675fc1f478e'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:32 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:58:32 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:32 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 1G" returned: 0 in 0.724s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b9946-71e7-4d86-b821-bbbc115a9e05]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:32 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:58:32 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:32 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.642s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:32 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:58:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Deleted volume successfully. Jul 01 06:58:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3c2f6dba-2aa8-468d-8e4c-83babe54306a tempest-VolumesExtendTest-1474280420 None] Lock "cinder-097d41f4-9a69-4b79-a443-4eeee00fa637-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:58:33 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 0.772s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:33 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:58:33 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:34 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 1 in 0.794s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Downloaded image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}])) to volume af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Temporary image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 for user 4f87a62c4b874a738ef39ef89c309316 is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Marking volume af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Copying metadata from image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 to af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Creating volume glance metadata for volume af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 backed by image 4507a0d3-aad2-4779-8b90-bdd1bccd3dd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02d9c17-ddf7-4e75-b45a-1ddb5067d8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9', 'volume_size': 1, 'image_id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21f9ddcb92794b0db4f67eb1d310da66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4507a0d3-aad2-4779-8b90-bdd1bccd3dd3', 'created_at': datetime.datetime(2026, 7, 1, 4, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 4, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4507a0d3-aad2-4779-8b90-bdd1bccd3dd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51c7192-b660-4362-be78-218e24f6f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:34 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Volume volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 (af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9): created successfully Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51c7192-b660-4362-be78-218e24f6f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:34 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Flow 'volume_create_manager' (e3ea9ca2-ad03-4d67-87a0-12bc1adfe442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9b68c440-6409-4226-a2fd-3483a4cfad87 tempest-TestShelveInstance-1231368503 None] Created volume successfully. Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Flow 'volume_create_manager' (3161c50e-8b54-46b4-86b4-2882c8139b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a620c32-2e83-4bee-9419-70e09f3bf858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a620c32-2e83-4bee-9419-70e09f3bf858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-520230717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7fe394-b93d-4649-8190-9702f7709ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bf3bbd241648e4a11c36da698eaaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:58:36Z,use_quota=True,user_id='9c1f90efb86e4edc8a0dc51b9d867978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13694827-e136-47d3-8a66-0c3478bcde26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13694827-e136-47d3-8a66-0c3478bcde26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cec124-5c7a-4b1e-ad97-eae298cbecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cec124-5c7a-4b1e-ad97-eae298cbecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7fe394-b93d-4649-8190-9702f7709ee5', 'volume_name': 'volume-7f7fe394-b93d-4649-8190-9702f7709ee5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f1b03c-ebfa-4929-b901-d66b37f46c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f1b03c-ebfa-4929-b901-d66b37f46c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab68e57-c225-4d7c-a3b1-370327a5a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:35 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Volume 7f7fe394-b93d-4649-8190-9702f7709ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7fe394-b93d-4649-8190-9702f7709ee5', 'volume_size': 1} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-520230717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7fe394-b93d-4649-8190-9702f7709ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bf3bbd241648e4a11c36da698eaaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:58:36Z,use_quota=True,user_id='9c1f90efb86e4edc8a0dc51b9d867978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Creating volume 7f7fe394-b93d-4649-8190-9702f7709ee5 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:58:35 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:58:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:35 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 1073741824 Jul 01 06:58:35 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:36 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 1073741824" returned: 0 in 0.923s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:36 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 Jul 01 06:58:36 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:37 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5" returned: 0 in 0.643s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab68e57-c225-4d7c-a3b1-370327a5a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7fe394-b93d-4649-8190-9702f7709ee5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4153baaa-04ee-42f7-b66e-bea6b33133e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:58:37 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Volume volume-7f7fe394-b93d-4649-8190-9702f7709ee5 (7f7fe394-b93d-4649-8190-9702f7709ee5): created successfully Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4153baaa-04ee-42f7-b66e-bea6b33133e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:58:37 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Flow 'volume_create_manager' (3161c50e-8b54-46b4-86b4-2882c8139b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:58:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5c246067-0f55-4984-8623-b87b88782fbd tempest-VolumesNegativeTest-193152111 None] Created volume successfully. Jul 01 06:58:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:58:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:58:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe69ecc-fcd0-42e2-a827-ad72f974915d]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:58:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:42 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:58:42 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:43 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 0.833s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:58:43 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:58:43 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:58:43 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 01 06:58:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 1 in 0.909s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:58:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:58:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.802s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:58:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49f8be09-9a85-41fb-8019-369dd96380fe', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:58:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-1a022d57-1043-4b16-9d11-85da4c773de2 req-ea815d67-ca7c-42c3-bb65-031a973eb377 tempest-TestShelveInstance-1231368503 None] attachment_update completed successfully. Jul 01 06:58:54 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=93,cinder:SELECT=75,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:58:54 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=80,cinder:UPDATE=87,cinder:INSERT=34,cinder:DELETE=7 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:59:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Acquiring lock "cinder-7f7fe394-b93d-4649-8190-9702f7709ee5-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Lock "cinder-7f7fe394-b93d-4649-8190-9702f7709ee5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Acquiring lock "cinder-quobyte-7f7fe394-b93d-4649-8190-9702f7709ee5" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Lock "cinder-quobyte-7f7fe394-b93d-4649-8190-9702f7709ee5" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:06 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2cbb7f-dee6-4cbb-8f05-3b960fc2afdd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:06 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 Jul 01 06:59:06 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:06 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5" returned: 0 in 0.788s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:06 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5 Jul 01 06:59:06 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:07 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7f7fe394-b93d-4649-8190-9702f7709ee5" returned: 0 in 0.678s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Lock "cinder-quobyte-7f7fe394-b93d-4649-8190-9702f7709ee5" released by "delete_volume" :: held 1.526s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Created reservations ['67baa0fa-599e-4c2d-9f8b-c16b5a09bf24', '85b3fdb0-e8aa-4b62-977a-e5af2f0fddae', 'f82c0e46-0962-4b12-85a1-f1c78a975082', 'be1ae062-7c69-463a-92f6-96b37daeb405'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:07 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:59:07 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:08 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.669s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:08 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:59:08 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Deleted volume successfully. Jul 01 06:59:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-968b98ae-7d42-43e7-8741-7018fdec7fb7 tempest-VolumesNegativeTest-193152111 None] Lock "cinder-7f7fe394-b93d-4649-8190-9702f7709ee5-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Flow 'volume_create_manager' (d16ffdd1-dcc8-4885-91f9-cfd6e856531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde3a55f-37da-41e1-9880-6a9cfeb66bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde3a55f-37da-41e1-9880-6a9cfeb66bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1215179187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526bcf03-4e82-4521-8034-aaedbd424d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07050040e8f2453890412a9f75852e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:59:10Z,use_quota=True,user_id='60b55ea57f23408f884e463026cc4dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074e9c44-1230-4bdd-8ad6-913a234d82d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074e9c44-1230-4bdd-8ad6-913a234d82d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae68ec8d-23b7-416f-a321-cbc27c268971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae68ec8d-23b7-416f-a321-cbc27c268971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526bcf03-4e82-4521-8034-aaedbd424d2d', 'volume_name': 'volume-526bcf03-4e82-4521-8034-aaedbd424d2d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac191b00-d2f6-4794-bf78-93332552e519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac191b00-d2f6-4794-bf78-93332552e519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a6514f-13dd-4bde-a105-879925546eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Volume 526bcf03-4e82-4521-8034-aaedbd424d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526bcf03-4e82-4521-8034-aaedbd424d2d', 'volume_size': 1} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1215179187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526bcf03-4e82-4521-8034-aaedbd424d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07050040e8f2453890412a9f75852e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:59:10Z,use_quota=True,user_id='60b55ea57f23408f884e463026cc4dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Creating volume 526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:59:10 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 06:59:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:10 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d 1073741824 Jul 01 06:59:10 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:11 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d 1073741824" returned: 0 in 0.822s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:11 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:11 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:12 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 0.648s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a6514f-13dd-4bde-a105-879925546eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526bcf03-4e82-4521-8034-aaedbd424d2d', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c6dc8a-4626-4bd2-96b3-a968a6fac012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Volume volume-526bcf03-4e82-4521-8034-aaedbd424d2d (526bcf03-4e82-4521-8034-aaedbd424d2d): created successfully Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c6dc8a-4626-4bd2-96b3-a968a6fac012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Flow 'volume_create_manager' (d16ffdd1-dcc8-4885-91f9-cfd6e856531e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:59:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-edd6a066-9f14-4958-966c-d8064483db0c tempest-VolumeDependencyTests-33299872 None] Created volume successfully. Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Creating offline snapshot bfadf19f-5cb6-4600-b39c-d477121d2350 of volume 526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d6b6b-3e2e-4e81-9b80-46047e1f9d2c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:12 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:12 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:13 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 0.775s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:13 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 1G Jul 01 06:59:13 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:14 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 1G" returned: 0 in 0.825s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-526bcf03-4e82-4521-8034-aaedbd424d2d -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:14 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-526bcf03-4e82-4521-8034-aaedbd424d2d -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 Jul 01 06:59:14 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:15 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-526bcf03-4e82-4521-8034-aaedbd424d2d -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350" returned: 0 in 0.715s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:15 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 is being set with open permissions: ugo+rw Jul 01 06:59:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:15 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 Jul 01 06:59:15 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:15 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:15 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info Jul 01 06:59:15 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:16 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info" returned: 0 in 0.657s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:16 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info is being set with open permissions: ugo+rw Jul 01 06:59:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:16 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info Jul 01 06:59:16 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:17 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.info" returned: 0 in 0.644s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-504960b7-4b0c-4c89-bc15-1401843535fb tempest-VolumeDependencyTests-33299872 None] Create snapshot completed successfully Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Flow 'volume_create_manager' (a8533e3f-abd9-4482-ac87-a22a4467e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e43b0fa-550c-470d-9a8a-378db82fb645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e43b0fa-550c-470d-9a8a-378db82fb645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248567336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bcaded-6869-4607-9e00-6bcc549727cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07050040e8f2453890412a9f75852e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bfadf19f-5cb6-4600-b39c-d477121d2350,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T04:59:19Z,use_quota=True,user_id='60b55ea57f23408f884e463026cc4dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7afbff8-8331-4b17-83ce-ffa52c4b061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7afbff8-8331-4b17-83ce-ffa52c4b061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3a1fab-17e7-4c00-b39a-214a9a7d8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3a1fab-17e7-4c00-b39a-214a9a7d8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31bcaded-6869-4607-9e00-6bcc549727cc', 'volume_name': 'volume-31bcaded-6869-4607-9e00-6bcc549727cc', 'volume_size': 1, 'snapshot_id': 'bfadf19f-5cb6-4600-b39c-d477121d2350'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e41f46-4607-4546-b8af-9061540961ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e41f46-4607-4546-b8af-9061540961ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773807ee-458a-451a-8132-0e3114927f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:18 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Volume 31bcaded-6869-4607-9e00-6bcc549727cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31bcaded-6869-4607-9e00-6bcc549727cc', 'volume_size': 1, 'snapshot_id': 'bfadf19f-5cb6-4600-b39c-d477121d2350'} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-quobyte-bfadf19f-5cb6-4600-b39c-d477121d2350-31bcaded-6869-4607-9e00-6bcc549727cc" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-bfadf19f-5cb6-4600-b39c-d477121d2350-31bcaded-6869-4607-9e00-6bcc549727cc" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Creating volume 31bcaded-6869-4607-9e00-6bcc549727cc from snapshot bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-quobyte-31bcaded-6869-4607-9e00-6bcc549727cc" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-31bcaded-6869-4607-9e00-6bcc549727cc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] snapshot: bfadf19f-5cb6-4600-b39c-d477121d2350, volume: 31bcaded-6869-4607-9e00-6bcc549727cc, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[210c1e5b-a982-444a-b9da-64f78f543db1]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:18 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 Jul 01 06:59:18 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:19 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350" returned: 0 in 0.791s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-526bcf03-4e82-4521-8034-aaedbd424d2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:59:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 06:59:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 06:59:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead346ca-b449-493f-ac44-b95d6858ccd3]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:19 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:19 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:20 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 1.001s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:20 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 06:59:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:20 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc Jul 01 06:59:20 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:25 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-b1b10747-019e-4e24-8a8a-20135c917574 req-6ccfb7d1-367a-4335-86b9-dd0a11a0886c tempest-TestShelveInstance-1231368503 None] Terminate volume connection completed successfully. Jul 01 06:59:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-b1b10747-019e-4e24-8a8a-20135c917574 req-6ccfb7d1-367a-4335-86b9-dd0a11a0886c tempest-TestShelveInstance-1231368503 None] Deleting attachment 49f8be09-9a85-41fb-8019-369dd96380fe. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 06:59:25 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc" returned: 0 in 5.357s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:25 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[66282563-6c20-4f90-8677-5db6473552da]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:26 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:26 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:26 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:59:26 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:26 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 0.943s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 06:59:26 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Converted 1024.00 MB image at 191.09 MB/s Jul 01 06:59:26 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc is being set with open permissions: ugo+rw Jul 01 06:59:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:26 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc Jul 01 06:59:26 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:27 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.681s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 06:59:27 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-31bcaded-6869-4607-9e00-6bcc549727cc" released by "_copy_volume_from_snapshot" :: held 8.861s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-bfadf19f-5cb6-4600-b39c-d477121d2350-31bcaded-6869-4607-9e00-6bcc549727cc" released by "_create_volume_from_snapshot" :: held 8.890s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.907s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773807ee-458a-451a-8132-0e3114927f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31bcaded-6869-4607-9e00-6bcc549727cc', 'volume_size': 1, 'snapshot_id': 'bfadf19f-5cb6-4600-b39c-d477121d2350'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ef80a0-7558-41c7-bd8d-592b22a61f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 06:59:27 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Volume volume-31bcaded-6869-4607-9e00-6bcc549727cc (31bcaded-6869-4607-9e00-6bcc549727cc): created successfully Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ef80a0-7558-41c7-bd8d-592b22a61f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 06:59:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Flow 'volume_create_manager' (a8533e3f-abd9-4482-ac87-a22a4467e120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 06:59:27 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-35f04986-665e-4f74-b616-aad8954a1213 tempest-VolumeDependencyTests-33299872 None] Created volume successfully. Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-bfadf19f-5cb6-4600-b39c-d477121d2350-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-bfadf19f-5cb6-4600-b39c-d477121d2350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-quobyte-526bcf03-4e82-4521-8034-aaedbd424d2d" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-526bcf03-4e82-4521-8034-aaedbd424d2d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-quobyte-bfadf19f-5cb6-4600-b39c-d477121d2350" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-bfadf19f-5cb6-4600-b39c-d477121d2350" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Deleting offline snapshot bfadf19f-5cb6-4600-b39c-d477121d2350 of volume 526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] snapshot_file for this snap is: volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd68c910-a7e5-45a1-abc4-a96782adfd7f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:28 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 Jul 01 06:59:28 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:29 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350" returned: 0 in 0.799s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:29 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-526bcf03-4e82-4521-8034-aaedbd424d2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 06:59:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0557b79-8121-4ac3-b11e-435a6db0d936]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:29 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:29 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:30 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 0.798s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:30 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 Jul 01 06:59:30 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:31 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350" returned: 0 in 0.752s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:31 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350 Jul 01 06:59:31 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:31 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d.bfadf19f-5cb6-4600-b39c-d477121d2350" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-bfadf19f-5cb6-4600-b39c-d477121d2350" released by "_delete_snapshot" :: held 3.125s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-526bcf03-4e82-4521-8034-aaedbd424d2d" released by "delete_snapshot" :: held 3.150s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Created reservations ['2e6965b3-ade9-43b5-9610-f6afe3d4b688', 'a6d10f44-13c7-49ae-be88-cd60cada28a9', '95cbd2e3-c94e-46b7-a6e2-0543181be1f5', 'd19917bf-c57f-4bf3-8966-f5c92d4b73ed'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:59:31 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Delete snapshot completed successfully. Jul 01 06:59:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3b8929bf-39ee-4c16-bf87-8a1acc7e973f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-bfadf19f-5cb6-4600-b39c-d477121d2350-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b01b8-d50a-4bf7-8ea4-a242494ff669]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:32 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:59:32 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-526bcf03-4e82-4521-8034-aaedbd424d2d-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-526bcf03-4e82-4521-8034-aaedbd424d2d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-quobyte-526bcf03-4e82-4521-8034-aaedbd424d2d" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-526bcf03-4e82-4521-8034-aaedbd424d2d" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6b5538-48e1-405d-a71a-4c65a21f30e0]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:33 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 0.815s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:33 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:33 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:33 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 06:59:33 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:33 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 0.780s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:33 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d Jul 01 06:59:33 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:33 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 1 in 0.764s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.619s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:33 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cd9a1a2-2718-450d-9692-341ea4a0f055', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 06:59:33 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-3d419386-9808-400c-8a3d-c83088bc86b0 req-348d2f70-ee6f-496e-b73c-63ed138ee82b tempest-TestShelveInstance-1231368503 None] attachment_update completed successfully. Jul 01 06:59:34 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-526bcf03-4e82-4521-8034-aaedbd424d2d" returned: 0 in 0.666s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-526bcf03-4e82-4521-8034-aaedbd424d2d" released by "delete_volume" :: held 1.503s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Created reservations ['8e160dfa-54c2-4bc9-9267-d13a0823100f', '4b954810-9367-4216-9081-ae1c527a8412', 'aa64b643-d913-42c2-84a5-30cac512d033', '78aa4bd5-5548-4ab1-adc9-6df0f652a131'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:34 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:59:34 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-31bcaded-6869-4607-9e00-6bcc549727cc-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-31bcaded-6869-4607-9e00-6bcc549727cc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:35 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "cinder-quobyte-31bcaded-6869-4607-9e00-6bcc549727cc" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.664s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:59:35 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Deleted volume successfully. Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-31bcaded-6869-4607-9e00-6bcc549727cc" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2ee1af1b-e681-4bf2-baf9-42fb05870f6f tempest-VolumeDependencyTests-33299872 None] Lock "cinder-526bcf03-4e82-4521-8034-aaedbd424d2d-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[29adc32e-811f-489e-8892-249d3aa14c53]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 06:59:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:35 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc Jul 01 06:59:35 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:36 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc" returned: 0 in 0.782s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:36 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc Jul 01 06:59:36 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:36 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-31bcaded-6869-4607-9e00-6bcc549727cc" returned: 0 in 0.698s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-quobyte-31bcaded-6869-4607-9e00-6bcc549727cc" released by "delete_volume" :: held 1.531s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Created reservations ['3224fda9-9729-494e-ba83-e0cf7348d1b8', '0d0b952c-d64f-4ed0-bff9-1df87f6efb4c', '4d5153d0-19ea-41fb-a0d8-9685bb776e72', '2fccf888-e4f0-4d21-8d97-cc85330ce70d'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 06:59:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 06:59:36 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 06:59:36 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 06:59:37 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 01 06:59:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 06:59:37 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 06:59:37 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Deleted volume successfully. Jul 01 06:59:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-99c5fa4e-fd7a-4f50-a9b9-c9c68b30a453 tempest-VolumeDependencyTests-33299872 None] Lock "cinder-31bcaded-6869-4607-9e00-6bcc549727cc-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 06:59:46 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 06:59:47 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=38,cinder:SELECT=35,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Flow 'volume_create_manager' (553436ad-b338-4d98-a114-3f234c9c55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab804011-27ca-4c5b-9432-1a348d2f159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab804011-27ca-4c5b-9432-1a348d2f159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1334377917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522e2093-8c48-4adb-8552-3dde362272d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fd9be62aa14dbbbfd6e1fed1ef31d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:00:01Z,use_quota=True,user_id='f5efb80ed6234a6f8bec8ef63b067e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d09bc8-9bdf-4e60-a342-36f69c7e300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d09bc8-9bdf-4e60-a342-36f69c7e300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37bec24-00d9-4103-a181-4d522e0d50f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37bec24-00d9-4103-a181-4d522e0d50f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522e2093-8c48-4adb-8552-3dde362272d9', 'volume_name': 'volume-522e2093-8c48-4adb-8552-3dde362272d9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ca2631-b721-4fad-9e93-b40aae05c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ca2631-b721-4fad-9e93-b40aae05c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d3bfaa-4205-46b1-a66d-6519af6ae4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:01 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Volume 522e2093-8c48-4adb-8552-3dde362272d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522e2093-8c48-4adb-8552-3dde362272d9', 'volume_size': 1} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1334377917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522e2093-8c48-4adb-8552-3dde362272d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fd9be62aa14dbbbfd6e1fed1ef31d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:00:01Z,use_quota=True,user_id='f5efb80ed6234a6f8bec8ef63b067e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Creating volume 522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:00:01 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:00:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:01 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 1073741824 Jul 01 07:00:01 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:02 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 1073741824" returned: 0 in 0.797s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:02 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:02 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:02 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.636s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d3bfaa-4205-46b1-a66d-6519af6ae4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522e2093-8c48-4adb-8552-3dde362272d9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83da5bb5-a169-4964-8fbd-c8981b41a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:02 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Volume volume-522e2093-8c48-4adb-8552-3dde362272d9 (522e2093-8c48-4adb-8552-3dde362272d9): created successfully Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83da5bb5-a169-4964-8fbd-c8981b41a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Flow 'volume_create_manager' (553436ad-b338-4d98-a114-3f234c9c55e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:00:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a917fa8a-ee77-464a-af50-f3984e4ed8b4 tempest-SnapshotDependencyTests-2028977037 None] Created volume successfully. Jul 01 07:00:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Creating offline snapshot 7624a88a-4b5b-4e58-a24a-c820dfc9c188 of volume 522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 07:00:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e26bef-e3b5-4429-802e-0e511a16b7da]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:03 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:03 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:04 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.746s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:04 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 1G Jul 01 07:00:04 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:05 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 1G" returned: 0 in 0.793s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522e2093-8c48-4adb-8552-3dde362272d9 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:05 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522e2093-8c48-4adb-8552-3dde362272d9 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 Jul 01 07:00:05 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:05 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522e2093-8c48-4adb-8552-3dde362272d9 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188" returned: 0 in 0.689s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:05 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 is being set with open permissions: ugo+rw Jul 01 07:00:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:05 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 Jul 01 07:00:05 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:06 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188" returned: 0 in 0.634s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:06 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info Jul 01 07:00:06 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:07 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info" returned: 0 in 0.654s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:07 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info is being set with open permissions: ugo+rw Jul 01 07:00:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:07 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info Jul 01 07:00:07 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:07 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.info" returned: 0 in 0.655s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-64700be9-79db-4e57-8f4d-f9061dd09e6e tempest-SnapshotDependencyTests-2028977037 None] Create snapshot completed successfully Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Flow 'volume_create_manager' (f06e6568-23e5-4705-98c0-df0826d73075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cb7010-f3b6-44e6-b4db-96921662ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cb7010-f3b6-44e6-b4db-96921662ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0163f1a-06b6-4c9e-abfa-10af279c1e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fd9be62aa14dbbbfd6e1fed1ef31d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7624a88a-4b5b-4e58-a24a-c820dfc9c188,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:00:09Z,use_quota=True,user_id='f5efb80ed6234a6f8bec8ef63b067e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cb2b18-45b9-4368-9928-054eb3942221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cb2b18-45b9-4368-9928-054eb3942221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdcd3ae-71b1-47da-a633-e29b9e9bfab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdcd3ae-71b1-47da-a633-e29b9e9bfab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0163f1a-06b6-4c9e-abfa-10af279c1e3b', 'volume_name': 'volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b', 'volume_size': 1, 'snapshot_id': '7624a88a-4b5b-4e58-a24a-c820dfc9c188'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ae317e-0a95-4f58-9fe0-ac814ecdc71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ae317e-0a95-4f58-9fe0-ac814ecdc71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7f32e4-42d2-4ef2-91e6-2a709c2ae5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Volume f0163f1a-06b6-4c9e-abfa-10af279c1e3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b', 'volume_size': 1, 'snapshot_id': '7624a88a-4b5b-4e58-a24a-c820dfc9c188'} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-quobyte-7624a88a-4b5b-4e58-a24a-c820dfc9c188-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-7624a88a-4b5b-4e58-a24a-c820dfc9c188-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Creating volume f0163f1a-06b6-4c9e-abfa-10af279c1e3b from snapshot 7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-quobyte-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] snapshot: 7624a88a-4b5b-4e58-a24a-c820dfc9c188, volume: f0163f1a-06b6-4c9e-abfa-10af279c1e3b, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52c4890-f9cc-4c06-9ca5-07ad9f8f26aa]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:09 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 Jul 01 07:00:09 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:10 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188" returned: 0 in 0.779s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522e2093-8c48-4adb-8552-3dde362272d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:00:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 07:00:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 07:00:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7821d1ca-9f3a-448a-a125-a2803d53e008]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:10 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:10 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:11 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.757s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:11 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 07:00:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:11 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b Jul 01 07:00:11 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:15 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" returned: 0 in 4.358s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:15 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8985c367-8063-4ff3-9af0-367a4142fd44]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:15 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:15 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:16 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.928s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:16 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:00:16 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Converted 1024.00 MB image at 234.92 MB/s Jul 01 07:00:16 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b is being set with open permissions: ugo+rw Jul 01 07:00:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:16 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b Jul 01 07:00:16 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:17 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" returned: 0 in 0.627s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" released by "_copy_volume_from_snapshot" :: held 7.555s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-7624a88a-4b5b-4e58-a24a-c820dfc9c188-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" released by "_create_volume_from_snapshot" :: held 7.589s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.615s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7f32e4-42d2-4ef2-91e6-2a709c2ae5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b', 'volume_size': 1, 'snapshot_id': '7624a88a-4b5b-4e58-a24a-c820dfc9c188'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8122e7-2891-4144-8f53-9ed2adc9c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:00:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Volume volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b (f0163f1a-06b6-4c9e-abfa-10af279c1e3b): created successfully Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8122e7-2891-4144-8f53-9ed2adc9c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:00:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Flow 'volume_create_manager' (f06e6568-23e5-4705-98c0-df0826d73075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:00:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f09ddfda-08c5-474b-b032-8c5336ea29a4 tempest-SnapshotDependencyTests-2028977037 None] Created volume successfully. Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-7624a88a-4b5b-4e58-a24a-c820dfc9c188-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-7624a88a-4b5b-4e58-a24a-c820dfc9c188-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-quobyte-522e2093-8c48-4adb-8552-3dde362272d9" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-522e2093-8c48-4adb-8552-3dde362272d9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-quobyte-7624a88a-4b5b-4e58-a24a-c820dfc9c188" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-7624a88a-4b5b-4e58-a24a-c820dfc9c188" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Deleting offline snapshot 7624a88a-4b5b-4e58-a24a-c820dfc9c188 of volume 522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] snapshot_file for this snap is: volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[59969e8e-1fb6-4b89-978b-d90d5167e919]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:18 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 Jul 01 07:00:18 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:18 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188" returned: 0 in 0.749s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522e2093-8c48-4adb-8552-3dde362272d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8f69f9-e4ab-4470-82fc-935db7b2c26e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:19 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:19 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:19 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.743s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:19 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 Jul 01 07:00:19 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:20 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188" returned: 0 in 0.739s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:20 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188 Jul 01 07:00:20 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:21 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9.7624a88a-4b5b-4e58-a24a-c820dfc9c188" returned: 0 in 0.639s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-7624a88a-4b5b-4e58-a24a-c820dfc9c188" released by "_delete_snapshot" :: held 2.965s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-522e2093-8c48-4adb-8552-3dde362272d9" released by "delete_snapshot" :: held 2.986s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Created reservations ['68e1da7e-90ac-4468-8913-b85ddf12b08b', 'd7122971-f825-4a2b-a751-2da1c344c0d9', '15e709f8-57c6-4089-8129-5a7994b890a8', 'e5f4f714-e5fe-47e6-8f23-050b8f5ad58b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:00:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Delete snapshot completed successfully. Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-18487f55-ae86-4a16-be60-f341baf9b2a7 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-7624a88a-4b5b-4e58-a24a-c820dfc9c188-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-522e2093-8c48-4adb-8552-3dde362272d9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-522e2093-8c48-4adb-8552-3dde362272d9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-quobyte-522e2093-8c48-4adb-8552-3dde362272d9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-522e2093-8c48-4adb-8552-3dde362272d9" acquired by "delete_volume" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a664b5a7-5ca1-4f2d-b55e-2fb12c0e0b4f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:21 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:21 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:22 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.759s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:22 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9 Jul 01 07:00:22 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:22 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-522e2093-8c48-4adb-8552-3dde362272d9" returned: 0 in 0.628s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-522e2093-8c48-4adb-8552-3dde362272d9" released by "delete_volume" :: held 1.443s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Created reservations ['b75bed74-8d94-47f8-8217-8ae634f72ef0', 'c94e8c1e-0cbd-4c1a-91c1-9c8f50645bef', '4b39bdb3-bafc-4ab4-a5b2-c8f965410892', '157d9b6e-eb6e-4c09-b012-b23156afba90'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:22 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:00:22 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:23 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.648s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:00:23 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Deleted volume successfully. Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-f0163f1a-06b6-4c9e-abfa-10af279c1e3b-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-f0163f1a-06b6-4c9e-abfa-10af279c1e3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-3d35c326-227d-458c-b771-71f1cc942f79 tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-522e2093-8c48-4adb-8552-3dde362272d9-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "cinder-quobyte-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494225c-f021-4547-b4f2-00b4208c1074]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:23 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b Jul 01 07:00:23 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:24 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" returned: 0 in 0.819s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:24 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b Jul 01 07:00:24 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:25 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" returned: 0 in 0.671s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-quobyte-f0163f1a-06b6-4c9e-abfa-10af279c1e3b" released by "delete_volume" :: held 1.536s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Created reservations ['a3715d98-bd74-4228-b31e-42925dc569c4', '8df8cbe7-1bfd-4e23-8599-12a3145b0762', 'f71945de-ca8f-415e-af1f-2bf847379f07', '35460c17-3db6-4906-af0d-11b958272a72'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:25 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:00:25 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:26 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.824s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:00:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Deleted volume successfully. Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1dcbd8f8-01e0-45e3-a8ba-22f3017bd6fc tempest-SnapshotDependencyTests-2028977037 None] Lock "cinder-f0163f1a-06b6-4c9e-abfa-10af279c1e3b-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:26 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:00:26 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:27 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.706s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:00:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:00:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:00:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:00:28 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-389d6c37-875a-4b59-aaac-46fe01f70266 tempest-TestShelveInstance-1231368503 None] Terminate volume connection completed successfully. Jul 01 07:00:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-389d6c37-875a-4b59-aaac-46fe01f70266 tempest-TestShelveInstance-1231368503 None] Deleting attachment 9cd9a1a2-2718-450d-9692-341ea4a0f055. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 07:00:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Acquiring lock "cinder-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Lock "cinder-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Acquiring lock "cinder-quobyte-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:00:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Lock "cinder-quobyte-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:00:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc905bc-e8f8-41c7-a32e-1c74bbadcdd9]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:00:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:29 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 07:00:29 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:30 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 0.830s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:30 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 07:00:30 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:30 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 1 in 0.781s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:00:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:30 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9 Jul 01 07:00:30 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:31 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" returned: 0 in 0.741s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Lock "cinder-quobyte-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9" released by "delete_volume" :: held 2.426s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG cinder.quota [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Created reservations ['9575b4e7-8746-4e89-b893-f1870fb6a46a', 'fbf1972c-322f-4754-8113-edfb6726f533', '0897a9a4-61ea-42cf-8255-a8753a5696e5', '905216b1-e686-459e-87e4-d32a6305360b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:00:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:00:31 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:00:31 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:00:32 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 01 07:00:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.747s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:00:32 devstack cinder-volume[86219]: DEBUG cinder.manager [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:00:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Deleted volume successfully. Jul 01 07:00:32 devstack cinder-volume[86219]: DEBUG cinder.coordination [req-78a1ac7f-0441-444d-8252-36535dc77e12 req-7d3413fc-1868-4ee4-8136-528112ca3c2a tempest-TestShelveInstance-1231368503 None] Lock "cinder-af722ff3-9fe0-4baa-acc6-faf7c2e2d1d9-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:00:46 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=39,cinder:SELECT=31,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:00:46 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=29,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=5 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Flow 'volume_create_manager' (6b1cd051-271b-437e-9746-73b93a24e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3a5b68-091e-4d8a-827f-a984d54ddcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3a5b68-091e-4d8a-827f-a984d54ddcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1113561413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905519a8-6c15-44a2-aa4d-80bba53adbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af01d74dcbb45e2a84473258d5a21bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:01:06Z,use_quota=True,user_id='b9b2422e9f834e6aaf3c3ded0ab05b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5019e1b1-9955-4721-a412-f8498e79800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5019e1b1-9955-4721-a412-f8498e79800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad27a4cb-cc6d-41db-a600-4442bbd7a0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad27a4cb-cc6d-41db-a600-4442bbd7a0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905519a8-6c15-44a2-aa4d-80bba53adbbb', 'volume_name': 'volume-905519a8-6c15-44a2-aa4d-80bba53adbbb', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad75a2-f6ac-4b57-bc47-4b2af4d32dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad75a2-f6ac-4b57-bc47-4b2af4d32dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1ffece-46e8-4ca8-a120-b93aafebb393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:01:06 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Volume 905519a8-6c15-44a2-aa4d-80bba53adbbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905519a8-6c15-44a2-aa4d-80bba53adbbb', 'volume_size': 1} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1113561413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905519a8-6c15-44a2-aa4d-80bba53adbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af01d74dcbb45e2a84473258d5a21bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:01:06Z,use_quota=True,user_id='b9b2422e9f834e6aaf3c3ded0ab05b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Creating volume 905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:01:06 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:01:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:06 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb 1073741824 Jul 01 07:01:06 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:07 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb 1073741824" returned: 0 in 0.885s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:07 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:01:07 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:07 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.660s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1ffece-46e8-4ca8-a120-b93aafebb393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905519a8-6c15-44a2-aa4d-80bba53adbbb', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77afb296-ab1d-4bbe-83e6-d6bf3032c4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:01:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Volume volume-905519a8-6c15-44a2-aa4d-80bba53adbbb (905519a8-6c15-44a2-aa4d-80bba53adbbb): created successfully Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77afb296-ab1d-4bbe-83e6-d6bf3032c4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:01:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Flow 'volume_create_manager' (6b1cd051-271b-437e-9746-73b93a24e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:01:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-956797e2-de9f-4dd6-82c2-b136733716b3 tempest-TestStampPattern-2129942697 None] Created volume successfully. Jul 01 07:01:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:01:17 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:01:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:26 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:01:26 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:27 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:01:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:01:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:01:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:01:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:01:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:01:46 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[68764ea6-59aa-4e7b-8aea-a298affe325c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:01:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:46 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:01:46 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:47 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.771s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:01:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-905519a8-6c15-44a2-aa4d-80bba53adbbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b35b8e9-d5e2-4b22-a36a-0dc93d626051', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 07:01:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-c5d7779e-1022-412f-b06c-92cd70920d94 req-fcfbd7e2-d856-41a4-8d07-001af9824ad1 tempest-TestStampPattern-2129942697 None] attachment_update completed successfully. Jul 01 07:01:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-ebba9e84-3884-4460-a92f-80aa1e7e1a2a req-23568d7a-200e-4db7-acd7-54a92dd51411 tempest-TestStampPattern-2129942697 None] Terminate volume connection completed successfully. Jul 01 07:01:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-ebba9e84-3884-4460-a92f-80aa1e7e1a2a req-23568d7a-200e-4db7-acd7-54a92dd51411 tempest-TestStampPattern-2129942697 None] Deleting attachment 4b35b8e9-d5e2-4b22-a36a-0dc93d626051. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 07:01:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:01:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:01:57 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Creating offline snapshot 05d6c0bf-f9db-4636-b519-920c0283bd97 of volume 905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 07:01:57 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[898eacf5-8112-4a93-a0ad-957f1ed8784d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:01:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:57 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:01:57 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:58 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.784s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:58 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 1G Jul 01 07:01:58 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:59 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 1G" returned: 0 in 0.802s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905519a8-6c15-44a2-aa4d-80bba53adbbb -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:59 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905519a8-6c15-44a2-aa4d-80bba53adbbb -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 Jul 01 07:01:59 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:01:59 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 01 07:01:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905519a8-6c15-44a2-aa4d-80bba53adbbb -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:01:59 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 is being set with open permissions: ugo+rw Jul 01 07:01:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:01:59 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 Jul 01 07:01:59 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:00 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97" returned: 0 in 0.659s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:00 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info Jul 01 07:02:00 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:01 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info" returned: 0 in 0.666s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:01 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info is being set with open permissions: ugo+rw Jul 01 07:02:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:01 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info Jul 01 07:02:01 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:01 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.info" returned: 0 in 0.638s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:02:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-cfa943d8-6758-4b98-822d-6f98a33ce9ac tempest-TestStampPattern-2129942697 None] Create snapshot completed successfully Jul 01 07:02:11 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Flow 'volume_create_manager' (6d0603ae-a245-4a91-ad23-314e1d400d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9a2291-0be4-4162-928e-ccc94e907702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9a2291-0be4-4162-928e-ccc94e907702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-236885656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a2559b-027c-4f4b-ba85-d94b3e3608e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af01d74dcbb45e2a84473258d5a21bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05d6c0bf-f9db-4636-b519-920c0283bd97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:02:13Z,use_quota=True,user_id='b9b2422e9f834e6aaf3c3ded0ab05b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c52770-fc7f-49e3-a16a-749427f44d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c52770-fc7f-49e3-a16a-749427f44d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f904f84c-a0fc-43d3-ac48-cebd3c5f929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f904f84c-a0fc-43d3-ac48-cebd3c5f929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02a2559b-027c-4f4b-ba85-d94b3e3608e0', 'volume_name': 'volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0', 'volume_size': 1, 'snapshot_id': '05d6c0bf-f9db-4636-b519-920c0283bd97'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e9ac51-a359-41d2-a88b-6120091d5f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e9ac51-a359-41d2-a88b-6120091d5f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2281b6b-3741-4b34-956c-ef4302247254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:02:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Volume 02a2559b-027c-4f4b-ba85-d94b3e3608e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0', 'volume_size': 1, 'snapshot_id': '05d6c0bf-f9db-4636-b519-920c0283bd97'} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-quobyte-05d6c0bf-f9db-4636-b519-920c0283bd97-02a2559b-027c-4f4b-ba85-d94b3e3608e0" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-05d6c0bf-f9db-4636-b519-920c0283bd97-02a2559b-027c-4f4b-ba85-d94b3e3608e0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Creating volume 02a2559b-027c-4f4b-ba85-d94b3e3608e0 from snapshot 05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-quobyte-02a2559b-027c-4f4b-ba85-d94b3e3608e0" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-02a2559b-027c-4f4b-ba85-d94b3e3608e0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] snapshot: 05d6c0bf-f9db-4636-b519-920c0283bd97, volume: 02a2559b-027c-4f4b-ba85-d94b3e3608e0, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae3b85-fa3e-4892-b88e-df1fc5025775]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:02:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:13 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 Jul 01 07:02:13 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:13 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97" returned: 0 in 0.785s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905519a8-6c15-44a2-aa4d-80bba53adbbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:02:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 07:02:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 07:02:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e81089-bc8c-4ae8-81fc-0981449a2019]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:02:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:13 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:02:13 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:14 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.796s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:14 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 07:02:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:14 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 Jul 01 07:02:14 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:19 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0" returned: 0 in 5.052s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:19 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fdb130-17e8-4b8d-b97a-69f686b364aa]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:02:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:19 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:02:19 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:20 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 1.275s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:20 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:02:20 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Converted 1024.00 MB image at 202.63 MB/s Jul 01 07:02:20 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 is being set with open permissions: ugo+rw Jul 01 07:02:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:20 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 Jul 01 07:02:20 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:21 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-02a2559b-027c-4f4b-ba85-d94b3e3608e0" released by "_copy_volume_from_snapshot" :: held 8.814s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-05d6c0bf-f9db-4636-b519-920c0283bd97-02a2559b-027c-4f4b-ba85-d94b3e3608e0" released by "_create_volume_from_snapshot" :: held 8.847s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.868s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2281b6b-3741-4b34-956c-ef4302247254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0', 'volume_size': 1, 'snapshot_id': '05d6c0bf-f9db-4636-b519-920c0283bd97'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2003243a-07dc-4fc0-82b5-8d732c250e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:02:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Volume volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 (02a2559b-027c-4f4b-ba85-d94b3e3608e0): created successfully Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2003243a-07dc-4fc0-82b5-8d732c250e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:02:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Flow 'volume_create_manager' (6d0603ae-a245-4a91-ad23-314e1d400d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:02:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c4822bc9-4da2-4f99-9827-4750c29e4e9d tempest-TestStampPattern-2129942697 None] Created volume successfully. Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:02:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:26 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:02:26 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:27 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.669s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:02:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:02:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:02:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:02:31 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:02:31 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:02:46 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:02:46 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:02:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:02:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:02:56 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff875f30-f658-4d5e-a958-9ebd33b2c4d3]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:02:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:02:56 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 Jul 01 07:02:56 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:02:57 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 01 07:02:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0" returned: 0 in 0.757s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:02:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:02:57 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313', 'name': 'volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f17ee667-ce97-45a2-8614-07817cbc8b83', 'enforce_multipath': True} {{(pid=86219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 07:02:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-2c050cb4-345b-4031-9c86-4f69131079af req-ea6b7788-bbe2-4bde-bd97-04bc73f93b53 tempest-TestStampPattern-2129942697 None] attachment_update completed successfully. Jul 01 07:03:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [req-ed0c5048-67d1-4057-955f-0daacf5948e9 req-b477b74f-6674-4a37-8435-5bfd13d1a69a tempest-TestStampPattern-2129942697 None] Terminate volume connection completed successfully. Jul 01 07:03:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [req-ed0c5048-67d1-4057-955f-0daacf5948e9 req-b477b74f-6674-4a37-8435-5bfd13d1a69a tempest-TestStampPattern-2129942697 None] Deleting attachment f17ee667-ce97-45a2-8614-07817cbc8b83. {{(pid=86219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 07:03:07 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:03:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-02a2559b-027c-4f4b-ba85-d94b3e3608e0-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Lock "cinder-02a2559b-027c-4f4b-ba85-d94b3e3608e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-quobyte-02a2559b-027c-4f4b-ba85-d94b3e3608e0" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-02a2559b-027c-4f4b-ba85-d94b3e3608e0" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[41175b59-90f9-4883-b531-ff0dc1e0be0e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:13 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 Jul 01 07:03:13 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:13 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0" returned: 0 in 0.827s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:13 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0 Jul 01 07:03:13 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:14 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-02a2559b-027c-4f4b-ba85-d94b3e3608e0" returned: 0 in 0.641s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-02a2559b-027c-4f4b-ba85-d94b3e3608e0" released by "delete_volume" :: held 1.509s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Created reservations ['dde4ff16-5fef-455b-bcfe-16b5d324ee99', '0a1666bb-e432-4054-86c3-603ab1c50d0c', '0dcc24ac-0cbb-4869-8232-f65546cabf21', '35b7736b-7907-41a2-93bf-ccafb8435ce4'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:03:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:14 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:03:14 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:15 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.670s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:03:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Deleted volume successfully. Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-fdbf8443-adb7-4936-9d70-3d548d381001 tempest-TestStampPattern-2129942697 None] Lock "cinder-02a2559b-027c-4f4b-ba85-d94b3e3608e0-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-05d6c0bf-f9db-4636-b519-920c0283bd97-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Lock "cinder-05d6c0bf-f9db-4636-b519-920c0283bd97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-quobyte-905519a8-6c15-44a2-aa4d-80bba53adbbb" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-905519a8-6c15-44a2-aa4d-80bba53adbbb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-quobyte-05d6c0bf-f9db-4636-b519-920c0283bd97" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-05d6c0bf-f9db-4636-b519-920c0283bd97" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Deleting offline snapshot 05d6c0bf-f9db-4636-b519-920c0283bd97 of volume 905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] snapshot_file for this snap is: volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb5211-6e6f-4de8-9168-fcb176968b0d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:15 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 Jul 01 07:03:15 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:16 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97" returned: 0 in 0.758s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:16 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905519a8-6c15-44a2-aa4d-80bba53adbbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:03:16 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db7a7b2-d20a-4477-a6d6-c8c5e045a751]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:16 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:03:16 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:17 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.792s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:17 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 Jul 01 07:03:17 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:17 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97" returned: 0 in 0.802s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:17 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97 Jul 01 07:03:17 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:18 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb.05d6c0bf-f9db-4636-b519-920c0283bd97" returned: 0 in 0.671s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-05d6c0bf-f9db-4636-b519-920c0283bd97" released by "_delete_snapshot" :: held 3.126s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-905519a8-6c15-44a2-aa4d-80bba53adbbb" released by "delete_snapshot" :: held 3.147s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:18 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Created reservations ['71ee6070-464a-4701-9567-f0911ee8c21d', 'e5fc85bc-052c-48b7-a0cc-c623a68d5abf', 'da16901a-7c5f-4cb6-a17f-6ffb87c8b9fa', '3590290a-1b8b-47cb-9de8-6e9049c51c4a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:03:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Delete snapshot completed successfully. Jul 01 07:03:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-70c2b71d-1393-4734-8a4b-2cdbb48f3c34 tempest-TestStampPattern-2129942697 None] Lock "cinder-05d6c0bf-f9db-4636-b519-920c0283bd97-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:26 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:03:26 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-905519a8-6c15-44a2-aa4d-80bba53adbbb-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Lock "cinder-905519a8-6c15-44a2-aa4d-80bba53adbbb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Acquiring lock "cinder-quobyte-905519a8-6c15-44a2-aa4d-80bba53adbbb" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-905519a8-6c15-44a2-aa4d-80bba53adbbb" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bce2f3-86fd-4ac6-ba76-b37d93ca7631]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:27 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:03:27 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:27 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:03:27 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.790s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:27 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb Jul 01 07:03:27 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:28 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-905519a8-6c15-44a2-aa4d-80bba53adbbb" returned: 0 in 0.657s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Lock "cinder-quobyte-905519a8-6c15-44a2-aa4d-80bba53adbbb" released by "delete_volume" :: held 1.512s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Created reservations ['f28095d4-4108-438b-b6f9-997e7c2d518d', '6471deb1-d7d6-40d4-8bf2-5e2dc0952dbf', 'a0b9d21e-0be1-4ec2-b6ec-54953d4a20de', '41207d7d-50a6-448e-835a-86df5be875d8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:03:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:28 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:03:28 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:29 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.674s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:29 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:03:29 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Deleted volume successfully. Jul 01 07:03:29 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-83197de5-6c7f-427a-9967-37f149d09703 tempest-TestStampPattern-2129942697 None] Lock "cinder-905519a8-6c15-44a2-aa4d-80bba53adbbb-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:38 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=20,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:03:39 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Flow 'volume_create_manager' (6e7c29ea-160e-4136-ba8b-ceb3a29f0663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4927ae5e-d0dc-4685-9869-0caa1f6ed783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4927ae5e-d0dc-4685-9869-0caa1f6ed783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a94aec61d94462288bc41f398c53724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:03:43Z,use_quota=True,user_id='09782b4b35754d889afb9353f88adf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df18acb4-4733-40df-bb4c-731cd9b3221c),volume_type_id=df18acb4-4733-40df-bb4c-731cd9b3221c)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497dca40-12ee-48e3-b260-be2229b016a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497dca40-12ee-48e3-b260-be2229b016a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50da354-1d6c-453d-9ece-4f398350aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50da354-1d6c-453d-9ece-4f398350aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18', 'volume_name': 'volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18', 'volume_size': 1, 'image_id': '41228871-0f2a-4905-84ce-45c09967fe57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41228871-0f2a-4905-84ce-45c09967fe57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed8fda5c57fb9afc169fb23faf604de9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a94aec61d94462288bc41f398c53724', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c6b9833bec65b79c9b615c1f5f611866dfb88321398ca12ff11206b8fa3a7d0a9abc16f841ae2e1abca1c6e4e833079a7fcd525e5127b049d5a5f717cea921b', 'id': '41228871-0f2a-4905-84ce-45c09967fe57', 'created_at': datetime.datetime(2026, 7, 1, 5, 3, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 3, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41228871-0f2a-4905-84ce-45c09967fe57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966e5694-82df-4ac2-a621-804e3eb280bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966e5694-82df-4ac2-a621-804e3eb280bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8e1325-03bc-47ef-97c2-33ee1716cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:03:42 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Volume 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18', 'volume_size': 1, 'image_id': '41228871-0f2a-4905-84ce-45c09967fe57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41228871-0f2a-4905-84ce-45c09967fe57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed8fda5c57fb9afc169fb23faf604de9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a94aec61d94462288bc41f398c53724', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c6b9833bec65b79c9b615c1f5f611866dfb88321398ca12ff11206b8fa3a7d0a9abc16f841ae2e1abca1c6e4e833079a7fcd525e5127b049d5a5f717cea921b', 'id': '41228871-0f2a-4905-84ce-45c09967fe57', 'created_at': datetime.datetime(2026, 7, 1, 5, 3, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 3, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41228871-0f2a-4905-84ce-45c09967fe57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 01 07:03:42 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Trying to clone 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 from image 41228871-0f2a-4905-84ce-45c09967fe57 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41228871-0f2a-4905-84ce-45c09967fe57', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 07:03:43 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 07:03:43 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Image download 0.00 MB at 0.00 MB/s Jul 01 07:03:43 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[70969877-f774-4c4d-b58f-ba63da6054df]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:43 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD Jul 01 07:03:43 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:43 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:43 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD Jul 01 07:03:43 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:44 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:03:44 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Temporary image 41228871-0f2a-4905-84ce-45c09967fe57 is fetched for user 09782b4b35754d889afb9353f88adf7b. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 07:03:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51df0eb-0137-473d-84d8-155e2f87e708]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:44 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD Jul 01 07:03:44 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:45 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:45 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD Jul 01 07:03:45 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:46 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a94aec61d94462288bc41f398c53724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:03:43Z,use_quota=True,user_id='09782b4b35754d889afb9353f88adf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df18acb4-4733-40df-bb4c-731cd9b3221c),volume_type_id=df18acb4-4733-40df-bb4c-731cd9b3221c)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Creating volume 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:03:46 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:03:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:46 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 1073741824 Jul 01 07:03:46 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:47 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 1073741824" returned: 0 in 0.831s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:47 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:47 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:47 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 0 in 0.629s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Attempting download of 41228871-0f2a-4905-84ce-45c09967fe57 ((None, [{'url': 'file:///opt/stack/data/glance/images/41228871-0f2a-4905-84ce-45c09967fe57', 'metadata': {}}])) to volume 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[abade44b-d034-4702-9125-08b89fe53adb]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:47 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh Jul 01 07:03:47 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:48 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh" returned: 0 in 0.714s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:48 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh Jul 01 07:03:48 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:49 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh" returned: 1 in 0.698s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41228871-0f2a-4905-84ce-45c09967fe57_qwfaovfh' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:03:49 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ba3b0-d657-45b9-b84e-f41cbd97e6d3]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:49 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD Jul 01 07:03:49 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:49 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:50 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD Jul 01 07:03:50 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:50 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD" returned: 1 in 0.696s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:03:50 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] 41228871-0f2a-4905-84ce-45c09967fe57 was raw, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 07:03:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:50 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:50 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:51 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 0 in 0.715s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:51 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41228871-0f2a-4905-84ce-45c09967fe57_4hkm8_wxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:03:51 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 07:03:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:51 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 1G Jul 01 07:03:51 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:52 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 1G" returned: 0 in 0.677s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[978c7d80-e508-4a73-a58f-ec5e05422683]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:52 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:52 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:52 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 0 in 0.727s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:52 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:52 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:53 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 1 in 0.738s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Downloaded image 41228871-0f2a-4905-84ce-45c09967fe57 ((None, [{'url': 'file:///opt/stack/data/glance/images/41228871-0f2a-4905-84ce-45c09967fe57', 'metadata': {}}])) to volume 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Temporary image 41228871-0f2a-4905-84ce-45c09967fe57 for user 09782b4b35754d889afb9353f88adf7b is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Marking volume 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Copying metadata from image 41228871-0f2a-4905-84ce-45c09967fe57 to 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Creating volume glance metadata for volume 4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 backed by image 41228871-0f2a-4905-84ce-45c09967fe57 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '41228871-0f2a-4905-84ce-45c09967fe57', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ed8fda5c57fb9afc169fb23faf604de9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8e1325-03bc-47ef-97c2-33ee1716cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18', 'volume_size': 1, 'image_id': '41228871-0f2a-4905-84ce-45c09967fe57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41228871-0f2a-4905-84ce-45c09967fe57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed8fda5c57fb9afc169fb23faf604de9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a94aec61d94462288bc41f398c53724', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c6b9833bec65b79c9b615c1f5f611866dfb88321398ca12ff11206b8fa3a7d0a9abc16f841ae2e1abca1c6e4e833079a7fcd525e5127b049d5a5f717cea921b', 'id': '41228871-0f2a-4905-84ce-45c09967fe57', 'created_at': datetime.datetime(2026, 7, 1, 5, 3, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 3, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41228871-0f2a-4905-84ce-45c09967fe57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea01303-9b82-417d-989c-3f3fc1c2302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:03:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Volume volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 (4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18): created successfully Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea01303-9b82-417d-989c-3f3fc1c2302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:03:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Flow 'volume_create_manager' (6e7c29ea-160e-4136-ba8b-ceb3a29f0663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:03:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-59a0c4f8-8e7c-47b4-821b-662cca8ef8b7 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Created volume successfully. Jul 01 07:03:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Acquiring lock "cinder-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "cinder-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Acquiring lock "cinder-quobyte-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:03:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "cinder-quobyte-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" acquired by "delete_volume" :: waited 0.013s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:03:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100bb33-71df-433b-b0e4-cc610d78a313]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:03:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:54 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:54 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:55 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 0 in 0.739s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:55 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:55 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:55 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 1 in 0.762s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:03:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:55 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18 Jul 01 07:03:55 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:56 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" returned: 0 in 0.627s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "cinder-quobyte-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18" released by "delete_volume" :: held 2.183s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:03:56 devstack cinder-volume[86219]: WARNING cinder.quota [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 01 07:03:56 devstack cinder-volume[86219]: WARNING cinder.quota [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Created reservations ['401581ae-1883-497c-ac74-bb84f9962925', '277ea202-5a2b-4654-be9f-cd9872c16ce7', 'cd9ebfd9-c9a2-4b45-b53a-64e6fc02527d', '0669775f-28b7-43d6-9e68-0b6e27be335f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:03:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:03:56 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:03:56 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:03:57 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 01 07:03:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.664s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:03:57 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:03:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Deleted volume successfully. Jul 01 07:03:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2f3068fd-428b-4770-a491-52099640cdc1 tempest-VolumeAndVolumeTypeFromImageTest-1790740878 None] Lock "cinder-4c7f5723-bbbf-43b0-9ac6-d79eae9d4f18-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (acaa7e04-05a7-4e65-a729-bc786d82150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bbb8b8-8d99-4de9-b65a-0fc6e6befa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bbb8b8-8d99-4de9-b65a-0fc6e6befa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070249801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f356a46f-9e16-4d93-a391-e7dfbc218d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:02Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354872c8-196a-455c-a569-c91ac4402f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354872c8-196a-455c-a569-c91ac4402f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0c7d07-9603-48cd-b508-9d3b09332c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0c7d07-9603-48cd-b508-9d3b09332c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f356a46f-9e16-4d93-a391-e7dfbc218d49', 'volume_name': 'volume-f356a46f-9e16-4d93-a391-e7dfbc218d49', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52164fd5-2fec-419b-a8cf-186ef8d85ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52164fd5-2fec-419b-a8cf-186ef8d85ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2150dfab-2017-497d-8dcc-d43c53744322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:01 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume f356a46f-9e16-4d93-a391-e7dfbc218d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f356a46f-9e16-4d93-a391-e7dfbc218d49', 'volume_size': 1} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070249801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f356a46f-9e16-4d93-a391-e7dfbc218d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:02Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Creating volume f356a46f-9e16-4d93-a391-e7dfbc218d49 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:01 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:01 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 1073741824 Jul 01 07:04:01 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:02 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 1073741824" returned: 0 in 0.823s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:02 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 Jul 01 07:04:02 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:03 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49" returned: 0 in 0.626s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2150dfab-2017-497d-8dcc-d43c53744322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f356a46f-9e16-4d93-a391-e7dfbc218d49', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cb533f-fe95-49b3-a6dd-19b4ace401d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:03 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 (f356a46f-9e16-4d93-a391-e7dfbc218d49): created successfully Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cb533f-fe95-49b3-a6dd-19b4ace401d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:03 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (acaa7e04-05a7-4e65-a729-bc786d82150b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1bf8b7d7-768a-4579-8d20-8f2e54ff03cf tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created volume successfully. Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (2a26303d-16bc-4119-b237-f72ea74ec0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f1387c-36b7-4a4e-9e64-95333161d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f1387c-36b7-4a4e-9e64-95333161d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588421824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971c0b16-5c64-4fc1-80ac-3b2e8baa6d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:04Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39ecc0-bf48-405d-9ad2-b3ad090bf07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39ecc0-bf48-405d-9ad2-b3ad090bf07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2e6d56-92b4-4754-a072-c4c1010c36e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2e6d56-92b4-4754-a072-c4c1010c36e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971c0b16-5c64-4fc1-80ac-3b2e8baa6d99', 'volume_name': 'volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b85022-f137-433d-89e7-ccd05cdd6cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b85022-f137-433d-89e7-ccd05cdd6cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30987871-5d3b-4d41-a3e5-b62683592e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume 971c0b16-5c64-4fc1-80ac-3b2e8baa6d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99', 'volume_size': 1} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588421824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971c0b16-5c64-4fc1-80ac-3b2e8baa6d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:04Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Creating volume 971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:04 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:04 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 1073741824 Jul 01 07:04:04 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (955ad250-df09-463f-941e-545ee8ab889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63096d97-1e25-4747-a48b-5edc1bbecf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63096d97-1e25-4747-a48b-5edc1bbecf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361677647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b47904-b63c-44fa-bd64-93842b6e895e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:05Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc0977a-452c-4aaa-9b70-e9b7358e32b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc0977a-452c-4aaa-9b70-e9b7358e32b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07925b72-9f58-4128-b7c4-7652971a06d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07925b72-9f58-4128-b7c4-7652971a06d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b47904-b63c-44fa-bd64-93842b6e895e', 'volume_name': 'volume-f5b47904-b63c-44fa-bd64-93842b6e895e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b00108-0991-40ec-ae23-bb786da1db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b00108-0991-40ec-ae23-bb786da1db92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b4fd90-d629-4d0f-abe6-e7d189ba748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:04 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume f5b47904-b63c-44fa-bd64-93842b6e895e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b47904-b63c-44fa-bd64-93842b6e895e', 'volume_size': 1} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (146efb73-aa72-47c9-8e4e-9ef5fc2ac710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:04 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e951b-a4bc-4564-9515-dd5433db2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e951b-a4bc-4564-9515-dd5433db2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-316937937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf5709f-c175-473c-a407-6d7d3953faa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:05Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad30a90-909e-4e20-90ee-ed0805f9bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad30a90-909e-4e20-90ee-ed0805f9bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55819a01-d251-4897-98d1-91840c8fe132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55819a01-d251-4897-98d1-91840c8fe132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf5709f-c175-473c-a407-6d7d3953faa3', 'volume_name': 'volume-bcf5709f-c175-473c-a407-6d7d3953faa3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b8ccec-f605-4387-82f4-5f8a6035fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b8ccec-f605-4387-82f4-5f8a6035fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1bac0d1-e836-461d-89d0-c2657584f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume bcf5709f-c175-473c-a407-6d7d3953faa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf5709f-c175-473c-a407-6d7d3953faa3', 'volume_size': 1} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:05 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 1073741824" returned: 0 in 0.923s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:05 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 Jul 01 07:04:05 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (2edf3f22-6d2d-4c22-903b-115d66664b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6136e62-ffac-4741-8307-ea84c76fafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6136e62-ffac-4741-8307-ea84c76fafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712961722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6bad98-d0ba-4ee3-9c80-d13b9193c103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:05Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910c6cfc-cd80-4e22-a5f2-129503a97dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910c6cfc-cd80-4e22-a5f2-129503a97dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41cd924-3df6-4ce2-b224-7e943e537cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41cd924-3df6-4ce2-b224-7e943e537cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6bad98-d0ba-4ee3-9c80-d13b9193c103', 'volume_name': 'volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632f010c-69f8-4d17-8c63-68affdc8a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632f010c-69f8-4d17-8c63-68affdc8a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e7388-c9dd-4ab8-8db6-a35d7bcbb02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume 7e6bad98-d0ba-4ee3-9c80-d13b9193c103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103', 'volume_size': 1} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (a4bc4a71-5e95-49c0-a865-e6394cb7007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5743655d-e56b-40e9-8209-b41b7b7d64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5743655d-e56b-40e9-8209-b41b7b7d64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051873631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd28ec7-5cc6-4c3b-81a7-c07c519baf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:06Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf1e57f-9a66-4ca6-b767-dad94e6353ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf1e57f-9a66-4ca6-b767-dad94e6353ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82969ecc-922d-4fed-acc6-79f883c4298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82969ecc-922d-4fed-acc6-79f883c4298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd28ec7-5cc6-4c3b-81a7-c07c519baf94', 'volume_name': 'volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4338e5-5d07-473d-8304-69e5ec3de58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4338e5-5d07-473d-8304-69e5ec3de58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a717ef9-b9a0-4177-b299-b731e6bca8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:05 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume 2cd28ec7-5cc6-4c3b-81a7-c07c519baf94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94', 'volume_size': 1} Jul 01 07:04:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:06 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99" returned: 0 in 0.710s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361677647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b47904-b63c-44fa-bd64-93842b6e895e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:05Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Creating volume f5b47904-b63c-44fa-bd64-93842b6e895e {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:06 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:06 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e 1073741824 Jul 01 07:04:06 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30987871-5d3b-4d41-a3e5-b62683592e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cd3cda-c2e5-4a14-99df-4c9fb6f5d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:06 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 (971c0b16-5c64-4fc1-80ac-3b2e8baa6d99): created successfully Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cd3cda-c2e5-4a14-99df-4c9fb6f5d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (2a26303d-16bc-4119-b237-f72ea74ec0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-65b69eed-868e-488d-95fa-cbc94139c0d4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created volume successfully. Jul 01 07:04:06 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e 1073741824" returned: 0 in 0.827s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:06 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e Jul 01 07:04:06 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:07 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e" returned: 0 in 0.634s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.459s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-316937937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf5709f-c175-473c-a407-6d7d3953faa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:05Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Creating volume bcf5709f-c175-473c-a407-6d7d3953faa3 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:07 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:07 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 1073741824 Jul 01 07:04:07 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b4fd90-d629-4d0f-abe6-e7d189ba748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b47904-b63c-44fa-bd64-93842b6e895e', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8de0acf-f8dc-42b7-ae05-62fb68f5a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume volume-f5b47904-b63c-44fa-bd64-93842b6e895e (f5b47904-b63c-44fa-bd64-93842b6e895e): created successfully Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8de0acf-f8dc-42b7-ae05-62fb68f5a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (955ad250-df09-463f-941e-545ee8ab889c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-cc362bf9-2f61-4cb8-a686-d7ce33823f1c tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created volume successfully. Jul 01 07:04:08 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 1073741824" returned: 0 in 0.816s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:08 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 Jul 01 07:04:08 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:09 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3" returned: 0 in 0.658s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.624s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712961722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6bad98-d0ba-4ee3-9c80-d13b9193c103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:05Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Creating volume 7e6bad98-d0ba-4ee3-9c80-d13b9193c103 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:09 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:09 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 1073741824 Jul 01 07:04:09 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1bac0d1-e836-461d-89d0-c2657584f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf5709f-c175-473c-a407-6d7d3953faa3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c420e01-d58b-4dc2-b4be-33cae6374ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume volume-bcf5709f-c175-473c-a407-6d7d3953faa3 (bcf5709f-c175-473c-a407-6d7d3953faa3): created successfully Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c420e01-d58b-4dc2-b4be-33cae6374ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (146efb73-aa72-47c9-8e4e-9ef5fc2ac710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8689381f-d3de-4b79-98e9-167006cb072d tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created volume successfully. Jul 01 07:04:09 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 1073741824" returned: 0 in 0.831s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:09 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 Jul 01 07:04:09 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:10 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103" returned: 0 in 0.646s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.786s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051873631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd28ec7-5cc6-4c3b-81a7-c07c519baf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614fc7736ded43ffaf1005f5f04d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:06Z,use_quota=True,user_id='79fc6e6a3e8841608240a411e57dc2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Creating volume 2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:10 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:10 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 1073741824 Jul 01 07:04:10 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e7388-c9dd-4ab8-8db6-a35d7bcbb02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97514f1f-2da3-46aa-85f6-55f1b7ec3d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 (7e6bad98-d0ba-4ee3-9c80-d13b9193c103): created successfully Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97514f1f-2da3-46aa-85f6-55f1b7ec3d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (2edf3f22-6d2d-4c22-903b-115d66664b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:10 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ba6833ed-0dca-4000-90d6-5adbdef5ee6b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created volume successfully. Jul 01 07:04:11 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 1073741824" returned: 0 in 0.867s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:11 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 Jul 01 07:04:11 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:12 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94" returned: 0 in 0.651s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a717ef9-b9a0-4177-b299-b731e6bca8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a15daf-a1cb-4d39-9fc4-054767acbc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:12 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Volume volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 (2cd28ec7-5cc6-4c3b-81a7-c07c519baf94): created successfully Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a15daf-a1cb-4d39-9fc4-054767acbc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:12 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Flow 'volume_create_manager' (a4bc4a71-5e95-49c0-a865-e6394cb7007c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-09ed2b14-56e4-42fc-bf1b-1974774963e7 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created volume successfully. Jul 01 07:04:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-quobyte-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94" acquired by "delete_volume" :: waited 0.012s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:13 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6633fb2-3851-46ce-a79c-c6627249cbd6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:13 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 Jul 01 07:04:13 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:14 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94" returned: 0 in 0.768s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:14 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94 Jul 01 07:04:14 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:14 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94" returned: 0 in 0.659s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94" released by "delete_volume" :: held 1.464s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created reservations ['f22bea65-2632-48e4-9e42-16992b02d46c', '72d853e8-cd07-40d3-9756-06ba1b22b903', '56a18656-b6c5-4c3f-bbcb-b1f258b6732e', '973e2d76-c902-4d2e-aa05-4c7f8c6fd0a3'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:14 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:14 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-7e6bad98-d0ba-4ee3-9c80-d13b9193c103-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-7e6bad98-d0ba-4ee3-9c80-d13b9193c103-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:15 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.660s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-quobyte-7e6bad98-d0ba-4ee3-9c80-d13b9193c103" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Deleted volume successfully. Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-d74ab957-d14a-4959-b646-709f87e1d2d9 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-2cd28ec7-5cc6-4c3b-81a7-c07c519baf94-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-7e6bad98-d0ba-4ee3-9c80-d13b9193c103" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba29a98-c5f0-4211-94f2-4dad2068d41c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:15 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 Jul 01 07:04:15 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:16 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103" returned: 0 in 0.738s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:16 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103 Jul 01 07:04:16 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:17 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7e6bad98-d0ba-4ee3-9c80-d13b9193c103" returned: 0 in 0.669s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-7e6bad98-d0ba-4ee3-9c80-d13b9193c103" released by "delete_volume" :: held 1.451s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created reservations ['90ef0c55-1993-418f-aed4-7713dd432d52', '979bf5f8-017e-44c4-bc4d-cd80af116d82', 'a87f0ad0-b945-448c-93ed-f7b51273ca29', '48bac53a-1119-4da9-9fec-676a207a759d'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:17 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:17 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-bcf5709f-c175-473c-a407-6d7d3953faa3-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-bcf5709f-c175-473c-a407-6d7d3953faa3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-quobyte-bcf5709f-c175-473c-a407-6d7d3953faa3" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-bcf5709f-c175-473c-a407-6d7d3953faa3" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f043a5-03ab-4656-a469-010dbbe0ad4c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:17 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.666s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:17 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Deleted volume successfully. Jul 01 07:04:17 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b76d6ff3-62c6-4c9b-83c8-796bb7a6dd9b tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-7e6bad98-d0ba-4ee3-9c80-d13b9193c103-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:17 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 Jul 01 07:04:17 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:18 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3" returned: 0 in 0.768s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:18 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3 Jul 01 07:04:18 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:19 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-bcf5709f-c175-473c-a407-6d7d3953faa3" returned: 0 in 0.676s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-bcf5709f-c175-473c-a407-6d7d3953faa3" released by "delete_volume" :: held 1.491s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created reservations ['ca008ff9-a02d-411c-b00c-945f64383357', 'b183df93-6a9c-403c-9a0d-9cf971078118', '4df1fc67-dbe4-4f6b-9c3d-169411c8a456', '88a426d8-9d64-4133-a352-60100a106c7f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:19 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:19 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:19 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-f5b47904-b63c-44fa-bd64-93842b6e895e-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-f5b47904-b63c-44fa-bd64-93842b6e895e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-quobyte-f5b47904-b63c-44fa-bd64-93842b6e895e" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-f5b47904-b63c-44fa-bd64-93842b6e895e" acquired by "delete_volume" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d727209a-ba56-4594-b3ea-17a65121268d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:20 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:20 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Deleted volume successfully. Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-96e27cee-83ad-46d9-b652-a81893c38720 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-bcf5709f-c175-473c-a407-6d7d3953faa3-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:20 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e Jul 01 07:04:20 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:20 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e" returned: 0 in 0.740s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:20 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e Jul 01 07:04:20 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:21 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f5b47904-b63c-44fa-bd64-93842b6e895e" returned: 0 in 0.635s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-f5b47904-b63c-44fa-bd64-93842b6e895e" released by "delete_volume" :: held 1.420s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created reservations ['b0875a75-459a-435c-aa85-dbc40da03438', '9fcac23f-6406-4b33-8a6a-0ccf976285e8', 'bc4ec350-8108-4fc8-9208-7ce69e45a908', '93eaf5d6-57d7-414e-b37d-8618e17fd5e6'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:21 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:21 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:22 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.658s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:22 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Deleted volume successfully. Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-quobyte-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-67270d13-4675-41cc-ad5b-a348e316baa4 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-f5b47904-b63c-44fa-bd64-93842b6e895e-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[10782a94-c4fb-4c4f-b5d2-01f579be5770]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:22 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 Jul 01 07:04:22 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:23 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99" returned: 0 in 0.740s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:23 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99 Jul 01 07:04:23 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:23 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99" returned: 0 in 0.645s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99" released by "delete_volume" :: held 1.424s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created reservations ['ac173108-644c-408a-82e2-bc862adb2ef9', '127cfdab-2314-430e-83f9-5939b9e14ccb', '22072c98-4dfc-4d8c-a4f4-ad84c37881e7', '7697a0f0-a076-4904-bbcd-f8d53917a01f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:23 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:23 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-f356a46f-9e16-4d93-a391-e7dfbc218d49-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-f356a46f-9e16-4d93-a391-e7dfbc218d49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:24 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.635s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:24 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Deleted volume successfully. Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "cinder-quobyte-f356a46f-9e16-4d93-a391-e7dfbc218d49" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-8b709d61-57fc-4463-b87d-6f0f2bcc9fb2 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-971c0b16-5c64-4fc1-80ac-3b2e8baa6d99-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-f356a46f-9e16-4d93-a391-e7dfbc218d49" acquired by "delete_volume" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1af29-6108-4f4f-8623-d851373c7fbd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:24 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 Jul 01 07:04:24 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:25 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49" returned: 0 in 0.777s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:25 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49 Jul 01 07:04:25 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:26 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f356a46f-9e16-4d93-a391-e7dfbc218d49" returned: 0 in 0.662s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-quobyte-f356a46f-9e16-4d93-a391-e7dfbc218d49" released by "delete_volume" :: held 1.476s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Created reservations ['dd1c17a4-9f10-417f-a804-a49f5c79963d', '74a363a5-fd29-4329-858b-ac346f82c11a', '5573499f-11ce-4ef1-81e2-d0804107ae8c', '164901d5-c3d5-4371-bf91-a84004f30cb9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:26 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:26 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:26 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:26 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:26 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.653s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Deleted volume successfully. Jul 01 07:04:26 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7815b9f7-389f-4c90-8f93-95ad6aa121c8 tempest-CreateVolumesFromSourceVolumeTest-1438479333 None] Lock "cinder-f356a46f-9e16-4d93-a391-e7dfbc218d49-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:27 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.675s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:04:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:04:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:04:36 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=47,cinder:INSERT=26,cinder:UPDATE=72,cinder:DELETE=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (07e62a14-737d-4c36-b014-318d8415762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f53ab9-4b16-4771-912a-ecc56930986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f53ab9-4b16-4771-912a-ecc56930986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739707799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705502f8-da65-4499-bccc-caea46a58732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:38Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238e7c93-e41e-4819-960d-321d4fe74b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238e7c93-e41e-4819-960d-321d4fe74b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c34bd8-e54b-4782-aa77-1a8ea7f11ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c34bd8-e54b-4782-aa77-1a8ea7f11ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705502f8-da65-4499-bccc-caea46a58732', 'volume_name': 'volume-705502f8-da65-4499-bccc-caea46a58732', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bce3123-f30e-4d07-81fa-a79fcecfdc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bce3123-f30e-4d07-81fa-a79fcecfdc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3ceaf8-9eff-45c4-af2b-bd468ac6a5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Volume 705502f8-da65-4499-bccc-caea46a58732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705502f8-da65-4499-bccc-caea46a58732', 'volume_size': 1} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739707799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705502f8-da65-4499-bccc-caea46a58732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:38Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Creating volume 705502f8-da65-4499-bccc-caea46a58732 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:38 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:38 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 1073741824 Jul 01 07:04:38 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (d047a233-1e10-4014-b5ab-30381a21f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5130303-25be-4d3d-9c3d-50b39989daed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5130303-25be-4d3d-9c3d-50b39989daed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696341890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efefc41-be19-414a-b862-e7732dffb0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:39Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341b1745-9db5-473e-bc52-45c92afa642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341b1745-9db5-473e-bc52-45c92afa642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3fe71a0-eb47-47de-8126-f82df55152b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3fe71a0-eb47-47de-8126-f82df55152b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efefc41-be19-414a-b862-e7732dffb0c0', 'volume_name': 'volume-1efefc41-be19-414a-b862-e7732dffb0c0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9786893-c885-4e27-a313-1a7522b9e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9786893-c885-4e27-a313-1a7522b9e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4079dc-5e58-4457-9365-206955e16345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:38 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume 1efefc41-be19-414a-b862-e7732dffb0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efefc41-be19-414a-b862-e7732dffb0c0', 'volume_size': 1} Jul 01 07:04:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (f60ae12d-9923-43ce-ab44-deb4feb04113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea419a4-b69c-46e6-9b88-b1252c077578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea419a4-b69c-46e6-9b88-b1252c077578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-761307941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25517486-9570-49ea-890c-1754c30a1ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:39Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c32d75-029d-4fc1-8927-e8fbb20624ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c32d75-029d-4fc1-8927-e8fbb20624ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fa1002-d8aa-4755-b93f-82a291da5748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fa1002-d8aa-4755-b93f-82a291da5748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25517486-9570-49ea-890c-1754c30a1ff9', 'volume_name': 'volume-25517486-9570-49ea-890c-1754c30a1ff9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a48286b-7501-4a8f-9217-6f0c780543f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a48286b-7501-4a8f-9217-6f0c780543f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2924e28b-eb68-4a76-bef6-80ce6a48de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Volume 25517486-9570-49ea-890c-1754c30a1ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25517486-9570-49ea-890c-1754c30a1ff9', 'volume_size': 1} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (e997dd25-1bee-4fb0-b5b7-6260a15a1154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16a773f-3060-4c9e-9b8f-976447fb5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:UPDATE=87,cinder:SELECT=68,cinder:INSERT=19,cinder:DELETE=8 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16a773f-3060-4c9e-9b8f-976447fb5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1909198027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95657def-b16a-4db5-abb6-a4ee836814d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:39Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c39a5b-1de1-4e99-87e3-1b5a28e1b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c39a5b-1de1-4e99-87e3-1b5a28e1b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d827c5-f319-4cbf-bd4f-f78effeffe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d827c5-f319-4cbf-bd4f-f78effeffe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95657def-b16a-4db5-abb6-a4ee836814d3', 'volume_name': 'volume-95657def-b16a-4db5-abb6-a4ee836814d3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50716bc8-26b2-48b0-b668-abc8518560cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50716bc8-26b2-48b0-b668-abc8518560cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fa7af2-ec96-4e90-b42a-ec80d084507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:39 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Volume 95657def-b16a-4db5-abb6-a4ee836814d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95657def-b16a-4db5-abb6-a4ee836814d3', 'volume_size': 1} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:39 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 1073741824" returned: 0 in 1.176s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:39 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 Jul 01 07:04:39 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (f20867a2-1ae1-461d-a7db-fc44fbce2a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53675774-aed4-4794-88e6-b92692e6002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53675774-aed4-4794-88e6-b92692e6002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086561900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6fb450-67a2-4ed4-8d4c-3e15597c1e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:40Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47a84d2-d386-40dc-b501-5db2be6f2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47a84d2-d386-40dc-b501-5db2be6f2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cce009-975f-41fa-a911-806aaede4308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cce009-975f-41fa-a911-806aaede4308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6fb450-67a2-4ed4-8d4c-3e15597c1e57', 'volume_name': 'volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f22592-8da2-4c6e-ad5e-58df1552da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f22592-8da2-4c6e-ad5e-58df1552da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f7a779-6f8e-4487-9f98-c4c04cef1ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Volume ca6fb450-67a2-4ed4-8d4c-3e15597c1e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57', 'volume_size': 1} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (926bc737-9abc-42dd-b7da-4840322578cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f2a59f-5d89-433e-9f75-a138a1422684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f2a59f-5d89-433e-9f75-a138a1422684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-16824137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c077b4a-45a2-42ab-a537-9c5c9b4c56cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:41Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e682b09c-c85f-43b7-a135-dc1ba9a9b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e682b09c-c85f-43b7-a135-dc1ba9a9b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efecb49-d75e-4653-bf11-13bb8deaa45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efecb49-d75e-4653-bf11-13bb8deaa45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c077b4a-45a2-42ab-a537-9c5c9b4c56cc', 'volume_name': 'volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68efa3d2-3d4e-4922-a1aa-be82076b8ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68efa3d2-3d4e-4922-a1aa-be82076b8ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e6e9c1-574c-45e9-93fd-945074b143af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Volume 1c077b4a-45a2-42ab-a537-9c5c9b4c56cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc', 'volume_size': 1} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:40 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732" returned: 0 in 1.039s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696341890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efefc41-be19-414a-b862-e7732dffb0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:39Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Creating volume 1efefc41-be19-414a-b862-e7732dffb0c0 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:40 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:40 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 1073741824 Jul 01 07:04:40 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3ceaf8-9eff-45c4-af2b-bd468ac6a5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705502f8-da65-4499-bccc-caea46a58732', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eed21e5-97d0-48e9-b3e3-8d122c7677b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Volume volume-705502f8-da65-4499-bccc-caea46a58732 (705502f8-da65-4499-bccc-caea46a58732): created successfully Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eed21e5-97d0-48e9-b3e3-8d122c7677b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (07e62a14-737d-4c36-b014-318d8415762c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:40 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0d5d6c24-70fb-48ff-8402-720d1ab759c6 tempest-CreateVolumesFromImageTest-952994987 None] Created volume successfully. Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Flow 'volume_create_manager' (8fe3e2ce-63ef-4940-ba61-9fa09fcdcfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4a5d01-606f-4a24-91cc-ead37f99f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4a5d01-606f-4a24-91cc-ead37f99f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9331aa58dd6d41b4b9ecba9bea4b4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:42Z,use_quota=True,user_id='e411526a37f84e2aa3afbd1d85f6fc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e46d60-c3aa-4a53-9802-2c0374f8af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e46d60-c3aa-4a53-9802-2c0374f8af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299537aa-fa8a-4ff3-bcb2-f0fb804078fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 07:04:41 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 1073741824" returned: 0 in 0.998s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:41 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 Jul 01 07:04:41 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299537aa-fa8a-4ff3-bcb2-f0fb804078fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b', 'volume_name': 'volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b', 'volume_size': 1, 'image_id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b982b3f33331e7e2c086428b91f4f974', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9331aa58dd6d41b4b9ecba9bea4b4706', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4aaf59fb38ae255c6d283750ba25bebfba130d018c3a131b7271481c6e18612e9d0aeb6c335ae9aa1b6fee7db847493be87ded753c0e62cd6c3e33b7f63bcc3e', 'id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'created_at': datetime.datetime(2026, 7, 1, 5, 4, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06/file', 'properties': {}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f32c9b6-bbde-4edc-9654-e711fc33ff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f32c9b6-bbde-4edc-9654-e711fc33ff63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d13530-1f7d-4536-aaa0-f4916c4a86b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:42 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Volume 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b', 'volume_size': 1, 'image_id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b982b3f33331e7e2c086428b91f4f974', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9331aa58dd6d41b4b9ecba9bea4b4706', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4aaf59fb38ae255c6d283750ba25bebfba130d018c3a131b7271481c6e18612e9d0aeb6c335ae9aa1b6fee7db847493be87ded753c0e62cd6c3e33b7f63bcc3e', 'id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'created_at': datetime.datetime(2026, 7, 1, 5, 4, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06/file', 'properties': {}}, 'image_service': } Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Trying to clone 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b from image fa87a17d-1bfc-4dc2-b104-39a7eded0b06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 07:04:42 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Image download 0.00 MB at 0.00 MB/s Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2689ecc-9767-42da-801c-5db5ad678ade]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:42 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD Jul 01 07:04:42 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:42 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0" returned: 0 in 0.708s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.451s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-761307941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25517486-9570-49ea-890c-1754c30a1ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:39Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Creating volume 25517486-9570-49ea-890c-1754c30a1ff9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:42 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4079dc-5e58-4457-9365-206955e16345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efefc41-be19-414a-b862-e7732dffb0c0', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1f6971-0977-4422-820b-5d79bc2390e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:42 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 1073741824 Jul 01 07:04:42 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:42 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume volume-1efefc41-be19-414a-b862-e7732dffb0c0 (1efefc41-be19-414a-b862-e7732dffb0c0): created successfully Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1f6971-0977-4422-820b-5d79bc2390e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:42 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (d047a233-1e10-4014-b5ab-30381a21f508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:42 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-24d4016a-25c5-4d79-bc83-a4aaf50ac20a tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created volume successfully. Jul 01 07:04:43 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Flow 'volume_create_manager' (ea7b5239-c83d-4879-9f32-ab3be7b9c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb542bb9-badc-4730-adde-a304498229ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb542bb9-badc-4730-adde-a304498229ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58262606-925a-41e8-8958-f989fb0a4e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16f590f904c66b350ba63b4676a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:43Z,use_quota=True,user_id='17acbb20c518482096ae69e89a73cd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbfb68e5-151d-4430-8017-abfd0133e3bb),volume_type_id=cbfb68e5-151d-4430-8017-abfd0133e3bb)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08ed659-c3e7-46d4-8749-752d9c9e0c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08ed659-c3e7-46d4-8749-752d9c9e0c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD Jul 01 07:04:43 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543cb989-2d35-45bf-bab7-1d86ea70a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.image.glance [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Creating Keystone auth plugin from conf {{(pid=86219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (7a918945-a0c2-4ff9-b6e5-1bdf21999d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472e2222-d4ad-4c9f-8d54-dc4e6b7aea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543cb989-2d35-45bf-bab7-1d86ea70a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58262606-925a-41e8-8958-f989fb0a4e63', 'volume_name': 'volume-58262606-925a-41e8-8958-f989fb0a4e63', 'volume_size': 1, 'image_id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b71e87c30d6d04fec6ed2b8320587e92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'caa16f590f904c66b350ba63b4676a8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05d214a73b7be274097ef9aa6a1344b82f23e629096241ef10783bad99232c65bec8ecfdb41f15992b50edab540978d0a2daaaeb7c9efc72551c2832d4a033b0', 'id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'created_at': datetime.datetime(2026, 7, 1, 5, 4, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 4, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff15187-c91f-4d0d-86e4-3a603ceb79ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff15187-c91f-4d0d-86e4-3a603ceb79ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3bb9d5-5ace-4959-86bd-9c64880900b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Volume 58262606-925a-41e8-8958-f989fb0a4e63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58262606-925a-41e8-8958-f989fb0a4e63', 'volume_size': 1, 'image_id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b71e87c30d6d04fec6ed2b8320587e92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'caa16f590f904c66b350ba63b4676a8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05d214a73b7be274097ef9aa6a1344b82f23e629096241ef10783bad99232c65bec8ecfdb41f15992b50edab540978d0a2daaaeb7c9efc72551c2832d4a033b0', 'id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'created_at': datetime.datetime(2026, 7, 1, 5, 4, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 4, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Trying to clone 58262606-925a-41e8-8958-f989fb0a4e63 from image 1b1aa55a-1cab-4a37-8dcb-5013466cde79 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'metadata': {}}]). {{(pid=86219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 07:04:43 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 1073741824" returned: 0 in 1.105s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472e2222-d4ad-4c9f-8d54-dc4e6b7aea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644191445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9e3b71-d4b8-4bff-a8a2-571001faf2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:44Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddec4ca-d0b0-4a5c-9566-f34ed92c7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddec4ca-d0b0-4a5c-9566-f34ed92c7340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de05ab21-9a18-4d44-a6c2-867a1800f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de05ab21-9a18-4d44-a6c2-867a1800f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9e3b71-d4b8-4bff-a8a2-571001faf2b5', 'volume_name': 'volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bde6b65-ca32-46fd-965a-aa27b512fc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bde6b65-ca32-46fd-965a-aa27b512fc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f977500-5b23-4834-8b7c-70ff615bc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:43 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume 3b9e3b71-d4b8-4bff-a8a2-571001faf2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5', 'volume_size': 1} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:43 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 Jul 01 07:04:43 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 07:04:44 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Image download 0.00 MB at 0.00 MB/s Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0763ced6-924a-469d-be31-9118b66f944d]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (4b6f6da7-60ae-4c4f-994d-c5f34b008b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3630fee-cefc-45be-80f5-5537dc36e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD Jul 01 07:04:44 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3630fee-cefc-45be-80f5-5537dc36e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839483956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4bff8b-fb0e-4617-8686-e658b2b95ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:44Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843b07bb-cc87-4327-bd7a-9fd46e25f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843b07bb-cc87-4327-bd7a-9fd46e25f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe0bce6-227b-4901-80db-298cd095d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe0bce6-227b-4901-80db-298cd095d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4bff8b-fb0e-4617-8686-e658b2b95ab7', 'volume_name': 'volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b889a87-1537-4db6-9321-d109738aa510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b889a87-1537-4db6-9321-d109738aa510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927404a2-659d-4c48-a5f3-8cd67f2a8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume be4bff8b-fb0e-4617-8686-e658b2b95ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7', 'volume_size': 1} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:44 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD" returned: 1 in 1.467s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Temporary image fa87a17d-1bfc-4dc2-b104-39a7eded0b06 is fetched for user e411526a37f84e2aa3afbd1d85f6fc8a. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ab3c86-8abb-4740-8a1a-c20fb341d313]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (7245a473-19a9-47b3-9978-eb3e58e78267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dc3084-99b3-4ccc-8bfe-2d545c770350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dc3084-99b3-4ccc-8bfe-2d545c770350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915574897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00dbd955-491a-4474-b34e-40bc20c60f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:45Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0cf3c5-ee06-43ea-b0e0-b366a8f8b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0cf3c5-ee06-43ea-b0e0-b366a8f8b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e74cb15-dbe7-429b-83a7-42ab1cf9f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e74cb15-dbe7-429b-83a7-42ab1cf9f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00dbd955-491a-4474-b34e-40bc20c60f73', 'volume_name': 'volume-00dbd955-491a-4474-b34e-40bc20c60f73', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1bd71c-3bf3-43b8-9de7-4d450d8da5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1bd71c-3bf3-43b8-9de7-4d450d8da5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c4c8e6-32eb-4378-912c-0fbc4cdf3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:44 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume 00dbd955-491a-4474-b34e-40bc20c60f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00dbd955-491a-4474-b34e-40bc20c60f73', 'volume_size': 1} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9" returned: 0 in 1.085s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.265s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1909198027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95657def-b16a-4db5-abb6-a4ee836814d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:39Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Creating volume 95657def-b16a-4db5-abb6-a4ee836814d3 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:45 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:45 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD Jul 01 07:04:45 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:45 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 1073741824 Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2924e28b-eb68-4a76-bef6-80ce6a48de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25517486-9570-49ea-890c-1754c30a1ff9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:45 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28d43a4-5066-4a75-b7b4-676137e9968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:45 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Volume volume-25517486-9570-49ea-890c-1754c30a1ff9 (25517486-9570-49ea-890c-1754c30a1ff9): created successfully Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28d43a4-5066-4a75-b7b4-676137e9968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (f60ae12d-9923-43ce-ab44-deb4feb04113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:45 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7a19228a-c6dd-4f0f-b71d-6549c89f4bf7 tempest-CreateVolumesFromImageTest-952994987 None] Created volume successfully. Jul 01 07:04:45 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD" returned: 0 in 1.166s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (d30a2e7e-f1e6-4632-90b1-e85403c39a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce28fd79-a6ca-4851-bb53-666038fb42de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:45 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD Jul 01 07:04:45 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce28fd79-a6ca-4851-bb53-666038fb42de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825994165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a420732-37da-4963-9bd4-e646259a7201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:45Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33742db0-3ccf-44c1-a4bd-643b9ea74af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33742db0-3ccf-44c1-a4bd-643b9ea74af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcbd8b1-4497-42de-b0ae-136c73486495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcbd8b1-4497-42de-b0ae-136c73486495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a420732-37da-4963-9bd4-e646259a7201', 'volume_name': 'volume-2a420732-37da-4963-9bd4-e646259a7201', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e94f349-1fae-430b-867c-9ecbfdd556e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e94f349-1fae-430b-867c-9ecbfdd556e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594bdf4f-4661-4390-9d42-65536ae605bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:45 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume 2a420732-37da-4963-9bd4-e646259a7201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a420732-37da-4963-9bd4-e646259a7201', 'volume_size': 1} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:45 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD" returned: 0 in 1.013s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:45 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD Jul 01 07:04:45 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:04:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (b3df20c1-29df-447f-b0d5-555bd1d8770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c77611-cbce-4cb4-a2ba-4a56d0b52e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c77611-cbce-4cb4-a2ba-4a56d0b52e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-379251808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1410fa7b-98f3-4ec2-a297-38bc7adf445c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:46Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fac0e73-d131-430c-943c-23fc67f0957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fac0e73-d131-430c-943c-23fc67f0957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46689238-93ea-4573-af6b-6ff134832b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46689238-93ea-4573-af6b-6ff134832b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1410fa7b-98f3-4ec2-a297-38bc7adf445c', 'volume_name': 'volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c31929-7685-43bf-a179-4b00074249e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c31929-7685-43bf-a179-4b00074249e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767730a7-e15b-43c9-8d33-cd93cc345013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume 1410fa7b-98f3-4ec2-a297-38bc7adf445c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c', 'volume_size': 1} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:46 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 1073741824" returned: 0 in 1.188s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:46 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 Jul 01 07:04:46 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:46 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD" returned: 1 in 1.011s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Temporary image 1b1aa55a-1cab-4a37-8dcb-5013466cde79 is fetched for user 17acbb20c518482096ae69e89a73cd97. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573c760-6329-4f3b-a928-cfaa4050c742]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:46 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD Jul 01 07:04:46 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:46 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD" returned: 1 in 0.791s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:46 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3" returned: 0 in 0.689s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.727s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086561900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6fb450-67a2-4ed4-8d4c-3e15597c1e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:40Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Creating volume ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:46 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:46 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 1073741824 Jul 01 07:04:46 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fa7af2-ec96-4e90-b42a-ec80d084507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95657def-b16a-4db5-abb6-a4ee836814d3', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:46 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae59d82-1483-468f-842b-d0e1e0e86a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:46 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Volume volume-95657def-b16a-4db5-abb6-a4ee836814d3 (95657def-b16a-4db5-abb6-a4ee836814d3): created successfully Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae59d82-1483-468f-842b-d0e1e0e86a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (e997dd25-1bee-4fb0-b5b7-6260a15a1154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:47 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a3ea4c8a-dc0e-4230-83fd-8ee018a13501 tempest-CreateVolumesFromImageTest-952994987 None] Created volume successfully. Jul 01 07:04:47 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:47 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD Jul 01 07:04:47 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:47 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 1073741824" returned: 0 in 0.867s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:47 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:04:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:47 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 Jul 01 07:04:47 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:48 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.756s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-16824137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c077b4a-45a2-42ab-a537-9c5c9b4c56cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e26b3c534e3466c96f225cd5f68f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:41Z,use_quota=True,user_id='6318331aa5dc464f831fa00f4cd3a85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Creating volume 1c077b4a-45a2-42ab-a537-9c5c9b4c56cc {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:48 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:48 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc 1073741824 Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f7a779-6f8e-4487-9f98-c4c04cef1ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:48 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a269891-94bb-49e1-9aaf-6bba96d61d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:48 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Volume volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 (ca6fb450-67a2-4ed4-8d4c-3e15597c1e57): created successfully Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a269891-94bb-49e1-9aaf-6bba96d61d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:48 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (f20867a2-1ae1-461d-a7db-fc44fbce2a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-25807bdd-9cd9-4a40-a024-320fc7e62d11 tempest-CreateVolumesFromImageTest-952994987 None] Created volume successfully. Jul 01 07:04:49 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc 1073741824" returned: 0 in 0.875s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:49 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc Jul 01 07:04:49 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:50 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc" returned: 0 in 0.635s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.246s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644191445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9e3b71-d4b8-4bff-a8a2-571001faf2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:44Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Creating volume 3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:50 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:50 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 1073741824 Jul 01 07:04:50 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e6e9c1-574c-45e9-93fd-945074b143af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df0e6c6-3073-46c3-975d-8c23403968e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:50 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Volume volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc (1c077b4a-45a2-42ab-a537-9c5c9b4c56cc): created successfully Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df0e6c6-3073-46c3-975d-8c23403968e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Flow 'volume_create_manager' (926bc737-9abc-42dd-b7da-4840322578cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:50 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-6d14e238-a707-474f-b8e4-ac3391f1c717 tempest-CreateVolumesFromImageTest-952994987 None] Created volume successfully. Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-quobyte-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc" acquired by "delete_volume" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7c080-d4a6-436d-ab83-3754e72746a5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:50 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc Jul 01 07:04:50 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:50 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 1073741824" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:51 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 Jul 01 07:04:51 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:51 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc" returned: 0 in 0.768s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:51 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc Jul 01 07:04:51 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:51 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5" returned: 0 in 0.659s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.214s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839483956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4bff8b-fb0e-4617-8686-e658b2b95ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:44Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Creating volume be4bff8b-fb0e-4617-8686-e658b2b95ab7 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:51 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:51 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 1073741824 Jul 01 07:04:51 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f977500-5b23-4834-8b7c-70ff615bc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fd7530-5ec3-4083-b492-2bf1764c00e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:51 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 (3b9e3b71-d4b8-4bff-a8a2-571001faf2b5): created successfully Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fd7530-5ec3-4083-b492-2bf1764c00e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:51 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (7a918945-a0c2-4ff9-b6e5-1bdf21999d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-071b328b-3a03-49a5-bf3a-a22ad1416f26 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created volume successfully. Jul 01 07:04:52 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc" returned: 0 in 0.716s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc" released by "delete_volume" :: held 1.524s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Created reservations ['5e6aac64-db90-44b6-8dda-deba047fdb1d', '66d190d2-64f7-4f34-ac8a-4825e2fdada0', 'ae04c8a1-595c-4a28-b6f6-f2c0a40f1b0b', 'fee493ca-1ec7-4cf6-b468-08e3f254c8ee'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:52 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:52 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:52 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 1073741824" returned: 0 in 0.903s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:52 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 Jul 01 07:04:52 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-quobyte-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:52 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d86376-b282-4ace-9c3d-3a48b29c4af8]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:53 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.732s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Deleted volume successfully. Jul 01 07:04:53 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 Jul 01 07:04:53 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7c12f176-fbe9-4386-a1a0-f1f8f11e685b tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-1c077b4a-45a2-42ab-a537-9c5c9b4c56cc-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:53 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7" returned: 0 in 0.676s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.322s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915574897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00dbd955-491a-4474-b34e-40bc20c60f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:45Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Creating volume 00dbd955-491a-4474-b34e-40bc20c60f73 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:53 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:53 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 1073741824 Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927404a2-659d-4c48-a5f3-8cd67f2a8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:53 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997c7a64-dd99-4252-88eb-bab69746c1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 (be4bff8b-fb0e-4617-8686-e658b2b95ab7): created successfully Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997c7a64-dd99-4252-88eb-bab69746c1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (4b6f6da7-60ae-4c4f-994d-c5f34b008b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-90a03cc3-87d8-4cc3-8de6-b98cb41be16b tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created volume successfully. Jul 01 07:04:53 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57" returned: 0 in 0.785s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:53 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57 Jul 01 07:04:53 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:54 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 1073741824" returned: 0 in 0.876s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:54 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 Jul 01 07:04:54 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:54 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57" returned: 0 in 0.669s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57" released by "delete_volume" :: held 1.516s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Created reservations ['a091046b-5863-4a61-bf2c-ddbefc41ee81', '930c6186-f30c-4361-9717-b2ce020d63c8', 'd6e33602-32ad-4f70-b0ca-4ad88541abb1', '5fa777e2-f6a7-46e5-834d-5fa0d4a2f06a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:54 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:54 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:54 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73" returned: 0 in 0.644s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.363s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825994165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a420732-37da-4963-9bd4-e646259a7201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:45Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Creating volume 2a420732-37da-4963-9bd4-e646259a7201 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:54 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:54 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 1073741824 Jul 01 07:04:54 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c4c8e6-32eb-4378-912c-0fbc4cdf3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00dbd955-491a-4474-b34e-40bc20c60f73', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36649d4f-70ec-4570-9476-fc66f1e307ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:54 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume volume-00dbd955-491a-4474-b34e-40bc20c60f73 (00dbd955-491a-4474-b34e-40bc20c60f73): created successfully Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36649d4f-70ec-4570-9476-fc66f1e307ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:54 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (7245a473-19a9-47b3-9978-eb3e58e78267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-8a18b015-0913-4af2-847e-f028f048ab92 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created volume successfully. Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-95657def-b16a-4db5-abb6-a4ee836814d3-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-95657def-b16a-4db5-abb6-a4ee836814d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-quobyte-95657def-b16a-4db5-abb6-a4ee836814d3" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-95657def-b16a-4db5-abb6-a4ee836814d3" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f382db-0f3b-44ca-b16f-7550c60b3236]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:55 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.719s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Deleted volume successfully. Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-92fdf2a3-8dc9-491e-a8f8-ad415d4e4393 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-ca6fb450-67a2-4ed4-8d4c-3e15597c1e57-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:55 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 Jul 01 07:04:55 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:55 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 1073741824" returned: 0 in 0.896s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:55 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 Jul 01 07:04:55 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:56 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3" returned: 0 in 0.810s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:56 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3 Jul 01 07:04:56 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:56 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201" returned: 0 in 0.674s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.432s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-379251808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1410fa7b-98f3-4ec2-a297-38bc7adf445c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed6e541cb774f3692051f4ec71c7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:46Z,use_quota=True,user_id='059c2b2c26ef4d5fa9266f2ea51a41b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Creating volume 1410fa7b-98f3-4ec2-a297-38bc7adf445c {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:56 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:56 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c 1073741824 Jul 01 07:04:56 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594bdf4f-4661-4390-9d42-65536ae605bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a420732-37da-4963-9bd4-e646259a7201', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b557b55c-2f61-4f84-97ce-bb6764656ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:56 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume volume-2a420732-37da-4963-9bd4-e646259a7201 (2a420732-37da-4963-9bd4-e646259a7201): created successfully Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b557b55c-2f61-4f84-97ce-bb6764656ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (d30a2e7e-f1e6-4632-90b1-e85403c39a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4ef0ff80-c62c-42fa-a493-26ac9e711625 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created volume successfully. Jul 01 07:04:56 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-95657def-b16a-4db5-abb6-a4ee836814d3" returned: 0 in 0.699s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-95657def-b16a-4db5-abb6-a4ee836814d3" released by "delete_volume" :: held 1.558s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Created reservations ['8dda9fff-dcbf-4fc1-a8b4-0030870297d4', '8d970082-8c42-41db-b6e1-a680746301c5', '4c7d7694-63cd-49da-b5e4-ecaa02656310', '644719f9-19aa-44e0-beaa-7ee26d626b6c'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:56 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:56 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-25517486-9570-49ea-890c-1754c30a1ff9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-25517486-9570-49ea-890c-1754c30a1ff9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:57 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c 1073741824" returned: 0 in 0.930s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-quobyte-25517486-9570-49ea-890c-1754c30a1ff9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-25517486-9570-49ea-890c-1754c30a1ff9" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af70a4-7032-41e1-9a24-8a59a4c76b1b]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:57 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c Jul 01 07:04:57 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:57 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.730s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:04:57 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Deleted volume successfully. Jul 01 07:04:57 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 Jul 01 07:04:57 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-14ca7af2-d29b-44c6-8539-f1fec61bc010 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-95657def-b16a-4db5-abb6-a4ee836814d3-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:58 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c" returned: 0 in 0.691s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.666s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9331aa58dd6d41b4b9ecba9bea4b4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:42Z,use_quota=True,user_id='e411526a37f84e2aa3afbd1d85f6fc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Creating volume 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:04:58 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:58 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b 1073741824 Jul 01 07:04:58 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767730a7-e15b-43c9-8d33-cd93cc345013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9242be4c-1604-4270-b99c-00ebaf369fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:04:58 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Volume volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c (1410fa7b-98f3-4ec2-a297-38bc7adf445c): created successfully Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9242be4c-1604-4270-b99c-00ebaf369fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Flow 'volume_create_manager' (b3df20c1-29df-447f-b0d5-555bd1d8770d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:04:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c31aa039-9974-406c-92ef-f4675c6ae3b1 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created volume successfully. Jul 01 07:04:58 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9" returned: 0 in 0.855s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:58 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9 Jul 01 07:04:58 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-1410fa7b-98f3-4ec2-a297-38bc7adf445c-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-1410fa7b-98f3-4ec2-a297-38bc7adf445c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-quobyte-1410fa7b-98f3-4ec2-a297-38bc7adf445c" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-1410fa7b-98f3-4ec2-a297-38bc7adf445c" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b6f538-e3b1-4b4a-8634-ee1026cfdf5d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:59 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-25517486-9570-49ea-890c-1754c30a1ff9" returned: 0 in 0.710s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-25517486-9570-49ea-890c-1754c30a1ff9" released by "delete_volume" :: held 1.614s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:04:59 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c Jul 01 07:04:59 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:59 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b 1073741824" returned: 0 in 0.941s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Created reservations ['b0e779f5-35ac-4d74-a88c-b9ad4b25918d', '9a20f570-a34e-40a3-bfe5-8732ea6fdb60', '2ca14c91-2bca-4f78-abb5-1e3da5056ee1', 'e94b64f5-4f84-421c-8f60-a5ca0a3d31bf'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:59 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:04:59 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:59 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:04:59 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-705502f8-da65-4499-bccc-caea46a58732-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-705502f8-da65-4499-bccc-caea46a58732-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "cinder-quobyte-705502f8-da65-4499-bccc-caea46a58732" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-705502f8-da65-4499-bccc-caea46a58732" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7e23a-682d-4ee7-b0f5-be110d5293a4]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:59 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c" returned: 0 in 0.877s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:04:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:04:59 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c Jul 01 07:04:59 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:04:59 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 Jul 01 07:04:59 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:00 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 0 in 0.810s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:00 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.179s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58262606-925a-41e8-8958-f989fb0a4e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16f590f904c66b350ba63b4676a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:04:43Z,use_quota=True,user_id='17acbb20c518482096ae69e89a73cd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbfb68e5-151d-4430-8017-abfd0133e3bb),volume_type_id=cbfb68e5-151d-4430-8017-abfd0133e3bb)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Creating volume 58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:00 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.800s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:00 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 1073741824 Jul 01 07:05:00 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Deleted volume successfully. Jul 01 07:05:00 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Attempting download of fa87a17d-1bfc-4dc2-b104-39a7eded0b06 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'metadata': {}}])) to volume 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9d3b1051-d310-4d0d-9598-61697e94c7fe tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-25517486-9570-49ea-890c-1754c30a1ff9-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8f41a3-eaff-4e39-baa5-68d050fb8572]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:00 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5 Jul 01 07:05:00 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:00 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1410fa7b-98f3-4ec2-a297-38bc7adf445c" returned: 0 in 0.802s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-1410fa7b-98f3-4ec2-a297-38bc7adf445c" released by "delete_volume" :: held 1.728s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:00 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732" returned: 0 in 0.912s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:00 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732 Jul 01 07:05:00 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created reservations ['b1e1f145-a656-4ca3-bf78-28cc06c7ef46', '9577ca65-26e5-4624-bf11-b1cd3f883d77', '7293972d-589b-484a-afe6-2d71a0a3ef26', '3182803e-fb8e-44dc-94af-6ea6b101029f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:00 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:00 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:01 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:01 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5" returned: 0 in 0.885s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 1073741824" returned: 0 in 1.020s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:01 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:01 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:01 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5 Jul 01 07:05:01 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-2a420732-37da-4963-9bd4-e646259a7201-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-2a420732-37da-4963-9bd4-e646259a7201-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-quobyte-2a420732-37da-4963-9bd4-e646259a7201" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-2a420732-37da-4963-9bd4-e646259a7201" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a68e00-5c8b-4c1c-84c9-e8e2203aae2c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:01 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 Jul 01 07:05:01 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:01 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-705502f8-da65-4499-bccc-caea46a58732" returned: 0 in 1.058s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:01 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.879s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-quobyte-705502f8-da65-4499-bccc-caea46a58732" released by "delete_volume" :: held 2.034s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Deleted volume successfully. Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0cf9f6aa-d59a-42de-a270-23217deba1ac tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-1410fa7b-98f3-4ec2-a297-38bc7adf445c-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:01 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 0 in 0.768s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Created reservations ['75dbcac2-14c4-4680-a037-4190423d65ee', 'a668eeea-9e13-48a5-8a72-6595c6b4f32e', '2e2fbf93-ab17-4830-a143-e9188912c21f', 'de79a046-7989-40a8-a83e-dd725ca9a57a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:01 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Attempting download of 1b1aa55a-1cab-4a37-8dcb-5013466cde79 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'metadata': {}}])) to volume 58262606-925a-41e8-8958-f989fb0a4e63. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[af40e55f-ba7e-4e38-8104-a801c69708b2]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:02 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:02 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:02 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks Jul 01 07:05:02 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:02 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5" returned: 1 in 1.132s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa87a17d-1bfc-4dc2-b104-39a7eded0b06__7x8efa5' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[511dee72-ac73-407c-bb85-fb82a7213683]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:02 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD Jul 01 07:05:02 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:02 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201" returned: 0 in 1.034s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:02 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201 Jul 01 07:05:02 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:02 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.811s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:02 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Deleted volume successfully. Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ea55c341-dfb9-4452-8a95-f8e44e9e6d69 tempest-CreateVolumesFromImageTest-952994987 None] Lock "cinder-705502f8-da65-4499-bccc-caea46a58732-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:02 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks" returned: 0 in 0.840s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:03 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:03 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks Jul 01 07:05:03 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:03 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD Jul 01 07:05:03 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:03 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-2a420732-37da-4963-9bd4-e646259a7201" returned: 0 in 0.792s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-2a420732-37da-4963-9bd4-e646259a7201" released by "delete_volume" :: held 1.868s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created reservations ['4ae8f033-224b-4156-ab7d-2186b470cef3', 'cbc2e7b3-c025-4ec1-96a1-1e0b0b258216', 'b9ba860b-6a9d-48fa-946b-e45f91827a6a', 'd09dfd09-bfe9-45f7-9d6e-69c2ec86c3dc'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:03 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:03 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:03 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks" returned: 1 in 0.790s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1aa55a-1cab-4a37-8dcb-5013466cde79_smgabiks' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2964ce6b-1480-4f1f-8407-bf883f0d0505]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-00dbd955-491a-4474-b34e-40bc20c60f73-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-00dbd955-491a-4474-b34e-40bc20c60f73-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-quobyte-00dbd955-491a-4474-b34e-40bc20c60f73" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-00dbd955-491a-4474-b34e-40bc20c60f73" acquired by "delete_volume" :: waited 0.030s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bb5360-3013-416c-9169-c8f5c9e5207f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:03 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD Jul 01 07:05:03 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:03 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD" returned: 1 in 0.932s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] fa87a17d-1bfc-4dc2-b104-39a7eded0b06 was raw, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 07:05:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:04 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:05:04 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:04 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 Jul 01 07:05:04 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:04 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.080s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:04 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:04 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Deleted volume successfully. Jul 01 07:05:04 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-b6775329-24b8-48c6-8650-f37ef427ef2d tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-2a420732-37da-4963-9bd4-e646259a7201-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:04 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD" returned: 0 in 1.095s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:04 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD Jul 01 07:05:04 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:05 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 0 in 1.061s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa87a17d-1bfc-4dc2-b104-39a7eded0b06_7rp0nseydevstack@QuobyteHD, size 0.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:05:05 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:05 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73" returned: 0 in 1.153s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:05 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b 1G Jul 01 07:05:05 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:05 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73 Jul 01 07:05:05 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:05 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD" returned: 1 in 0.936s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] 1b1aa55a-1cab-4a37-8dcb-5013466cde79 was raw, converting to raw {{(pid=86219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:05 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:05 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:05 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b 1G" returned: 0 in 0.808s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:05 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-00dbd955-491a-4474-b34e-40bc20c60f73" returned: 0 in 0.804s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-00dbd955-491a-4474-b34e-40bc20c60f73" released by "delete_volume" :: held 2.008s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0f53c1-2294-42da-8253-f86790067f7b]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:05 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created reservations ['3fcbfd16-be01-4e17-b512-4febe03c5fad', 'e0497276-901f-4f74-914f-d5f5cc663de8', 'bb2cb9b5-8d76-4368-9fe9-34264d32f34c', 'f64a3f2e-3e34-4605-a78e-9722652f008b'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:06 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:05:06 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:06 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:06 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:06 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 0 in 0.910s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b1aa55a-1cab-4a37-8dcb-5013466cde79_e6cua_psdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:05:06 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:06 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 1G Jul 01 07:05:06 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:06 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 0 in 0.935s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:06 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.889s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:06 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Deleted volume successfully. Jul 01 07:05:06 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:05:06 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:06 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (a97f3f75-f724-408f-8c66-4885bccfb74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce98b240-0326-426e-9384-bc1b604ceefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0fcea73f-2315-4296-b738-c9391a80b3ca tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-00dbd955-491a-4474-b34e-40bc20c60f73-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce98b240-0326-426e-9384-bc1b604ceefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365092524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:07Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecb5b12-6173-483e-b9ce-afaaea4015bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecb5b12-6173-483e-b9ce-afaaea4015bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea013a9-9a13-4efe-9ff1-b5d4868e6717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea013a9-9a13-4efe-9ff1-b5d4868e6717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1', 'volume_name': 'volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31583265-66e1-4c44-9346-fb22c50672f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31583265-66e1-4c44-9346-fb22c50672f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f64df5e-8c89-46c3-8f0b-a8f9fdecc03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume 84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1', 'volume_size': 1} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365092524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:07Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating volume 84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:07 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:07 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 1073741824 Jul 01 07:05:07 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-be4bff8b-fb0e-4617-8686-e658b2b95ab7-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-be4bff8b-fb0e-4617-8686-e658b2b95ab7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-quobyte-be4bff8b-fb0e-4617-8686-e658b2b95ab7" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-be4bff8b-fb0e-4617-8686-e658b2b95ab7" acquired by "delete_volume" :: waited 0.016s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160e757-8563-4182-850b-01076a0eb923]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:07 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:07 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 Jul 01 07:05:07 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 1G" returned: 0 in 0.775s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[52661278-61e5-426f-be3b-794bb349fb5e]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:07 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:07 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:07 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 1 in 0.857s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Downloaded image fa87a17d-1bfc-4dc2-b104-39a7eded0b06 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'metadata': {}}])) to volume 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Temporary image fa87a17d-1bfc-4dc2-b104-39a7eded0b06 for user e411526a37f84e2aa3afbd1d85f6fc8a is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Marking volume 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Copying metadata from image fa87a17d-1bfc-4dc2-b104-39a7eded0b06 to 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Creating volume glance metadata for volume 0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b backed by image fa87a17d-1bfc-4dc2-b104-39a7eded0b06 with: {'image_id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b982b3f33331e7e2c086428b91f4f974', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d13530-1f7d-4536-aaa0-f4916c4a86b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b', 'volume_size': 1, 'image_id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b982b3f33331e7e2c086428b91f4f974', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9331aa58dd6d41b4b9ecba9bea4b4706', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4aaf59fb38ae255c6d283750ba25bebfba130d018c3a131b7271481c6e18612e9d0aeb6c335ae9aa1b6fee7db847493be87ded753c0e62cd6c3e33b7f63bcc3e', 'id': 'fa87a17d-1bfc-4dc2-b104-39a7eded0b06', 'created_at': datetime.datetime(2026, 7, 1, 5, 4, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa87a17d-1bfc-4dc2-b104-39a7eded0b06/file', 'properties': {}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0230e8-4c0d-42fd-8b37-e90deaf3f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:07 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Volume volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b (0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b): created successfully Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0230e8-4c0d-42fd-8b37-e90deaf3f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:07 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Flow 'volume_create_manager' (8fe3e2ce-63ef-4940-ba61-9fa09fcdcfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:07 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a3be8198-6ba4-4945-9b86-cb4abc8e0c87 tempest-VolumeImageDependencyTests-1872227612 None] Created volume successfully. Jul 01 07:05:08 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 1073741824" returned: 0 in 1.069s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:08 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7" returned: 0 in 0.888s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:08 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7 Jul 01 07:05:08 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:08 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 Jul 01 07:05:08 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:08 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 0 in 0.928s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:08 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:08 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Acquiring lock "cinder-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Lock "cinder-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:08 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" returned: 0 in 0.705s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Acquiring lock "cinder-quobyte-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:08 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-be4bff8b-fb0e-4617-8686-e658b2b95ab7" returned: 0 in 0.742s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f64df5e-8c89-46c3-8f0b-a8f9fdecc03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cb49f2-10cb-487c-a9ba-b82072b56dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Lock "cinder-quobyte-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" acquired by "delete_volume" :: waited 0.050s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:08 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-be4bff8b-fb0e-4617-8686-e658b2b95ab7" released by "delete_volume" :: held 1.708s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 (84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1): created successfully Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cb49f2-10cb-487c-a9ba-b82072b56dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (a97f3f75-f724-408f-8c66-4885bccfb74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8358b501-6241-456d-849a-c28b43d5b5db]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-a2aef45a-a52f-47c6-b620-5f4e985c0da4 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created volume successfully. Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created reservations ['8772a8c0-3c96-4846-8d1c-98c6a907a618', 'a6d5135a-509c-4f3c-9acb-a679ed825a89', '89e6fe62-7852-4832-a490-a7712e9edd6a', '3c6363a4-6258-4aef-b196-9363ca16fc3a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:09 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:05:09 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:09 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:09 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:09 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 1 in 0.852s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Downloaded image 1b1aa55a-1cab-4a37-8dcb-5013466cde79 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'metadata': {}}])) to volume 58262606-925a-41e8-8958-f989fb0a4e63 successfully. {{(pid=86219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Temporary image 1b1aa55a-1cab-4a37-8dcb-5013466cde79 for user 17acbb20c518482096ae69e89a73cd97 is deleted. {{(pid=86219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.volume_utils [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Marking volume 58262606-925a-41e8-8958-f989fb0a4e63 as bootable. {{(pid=86219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Copying metadata from image 1b1aa55a-1cab-4a37-8dcb-5013466cde79 to 58262606-925a-41e8-8958-f989fb0a4e63. {{(pid=86219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Creating volume glance metadata for volume 58262606-925a-41e8-8958-f989fb0a4e63 backed by image 1b1aa55a-1cab-4a37-8dcb-5013466cde79 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b71e87c30d6d04fec6ed2b8320587e92', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3bb9d5-5ace-4959-86bd-9c64880900b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58262606-925a-41e8-8958-f989fb0a4e63', 'volume_size': 1, 'image_id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b71e87c30d6d04fec6ed2b8320587e92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'caa16f590f904c66b350ba63b4676a8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05d214a73b7be274097ef9aa6a1344b82f23e629096241ef10783bad99232c65bec8ecfdb41f15992b50edab540978d0a2daaaeb7c9efc72551c2832d4a033b0', 'id': '1b1aa55a-1cab-4a37-8dcb-5013466cde79', 'created_at': datetime.datetime(2026, 7, 1, 5, 4, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 5, 4, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b1aa55a-1cab-4a37-8dcb-5013466cde79/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86c645f-dea7-4383-9ad4-237cb8a73f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:09 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Volume volume-58262606-925a-41e8-8958-f989fb0a4e63 (58262606-925a-41e8-8958-f989fb0a4e63): created successfully Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86c645f-dea7-4383-9ad4-237cb8a73f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Flow 'volume_create_manager' (ea7b5239-c83d-4879-9f32-ab3be7b9c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-15289668-bf42-4120-9894-9cf7af743ae3 tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Created volume successfully. Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-quobyte-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5" acquired by "delete_volume" :: waited 0.018s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe2979-abe4-428c-bb84-482c112b22e9]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:09 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 Jul 01 07:05:09 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:09 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.682s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:09 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Deleted volume successfully. Jul 01 07:05:09 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 0 in 0.843s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:09 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c7449339-c38a-4b44-8eec-edb855facc27 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-be4bff8b-fb0e-4617-8686-e658b2b95ab7-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:09 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:05:09 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Acquiring lock "cinder-58262606-925a-41e8-8958-f989fb0a4e63-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "cinder-58262606-925a-41e8-8958-f989fb0a4e63-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating offline snapshot 249592bc-c50f-4ba7-a48b-e6a4d0ea7333 of volume 84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 07:05:10 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5" returned: 0 in 0.857s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ab832-b69f-407d-a1ad-1096b7f83718]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Acquiring lock "cinder-quobyte-58262606-925a-41e8-8958-f989fb0a4e63" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:10 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5 Jul 01 07:05:10 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "cinder-quobyte-58262606-925a-41e8-8958-f989fb0a4e63" acquired by "delete_volume" :: waited 0.036s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db46cb5-7161-4c02-b90f-d734b0729a0e]: (4, 'raw') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:10 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 Jul 01 07:05:10 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:10 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:10 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:10 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 1 in 0.929s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:10 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b Jul 01 07:05:10 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:11 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5" returned: 0 in 0.764s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5" released by "delete_volume" :: held 1.668s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created reservations ['a7454f5e-ed49-4f45-bd49-cd5fe5be530e', '20ea8fde-b563-4622-92f6-39996dc88c61', 'e296cbf5-5f0e-4581-877b-0bdad6f6921f', '06cf4671-9081-4439-a277-6fdc821ca6c8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:11 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" returned: 0 in 0.897s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:11 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 1G Jul 01 07:05:11 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:11 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 0 in 0.878s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:11 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:11 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:11 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:11 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:11 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" returned: 0 in 0.749s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Lock "cinder-quobyte-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b" released by "delete_volume" :: held 2.592s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Created reservations ['51d6e3c2-f60b-4a3e-a6ac-cab0ee8330ec', 'f16b2a48-b0cc-44f1-a59e-e395c153c62a', 'e5e7740b-c4a5-4695-84a3-3acd37eb8e9f', 'c70c1699-9ae4-4dfe-b4c2-370a37ee9ba8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-1efefc41-be19-414a-b862-e7732dffb0c0-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:11 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:11 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-1efefc41-be19-414a-b862-e7732dffb0c0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "cinder-quobyte-1efefc41-be19-414a-b862-e7732dffb0c0" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-1efefc41-be19-414a-b862-e7732dffb0c0" acquired by "delete_volume" :: waited 0.035s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b273a71f-55bb-4e2d-94af-d32a5d9d64bc]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:12 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 Jul 01 07:05:12 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:12 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 1 in 0.932s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63' failed. Not Retrying. {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:12 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63 Jul 01 07:05:12 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:12 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.020s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Deleted volume successfully. Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-09ea43a0-53b7-4d8c-96dd-7f36e1004575 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-3b9e3b71-d4b8-4bff-a8a2-571001faf2b5-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:12 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 1G" returned: 0 in 1.318s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:12 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.906s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:12 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Deleted volume successfully. Jul 01 07:05:12 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 Jul 01 07:05:12 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:12 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-56c8c1db-df3e-4656-9426-3a780aae5ce9 tempest-VolumeImageDependencyTests-1872227612 None] Lock "cinder-0d1ac4ae-0b88-4640-b6d6-7ed45d6a950b-delete_volume" released by "delete_volume" :: held 3.875s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:13 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0" returned: 0 in 1.085s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:13 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0 Jul 01 07:05:13 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:13 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-58262606-925a-41e8-8958-f989fb0a4e63" returned: 0 in 0.878s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "cinder-quobyte-58262606-925a-41e8-8958-f989fb0a4e63" released by "delete_volume" :: held 2.773s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Created reservations ['3ce48b34-adad-4394-b819-07a0298e77a6', '25bb3a2e-b783-491d-8994-6b0ea9ef09c8', '67cfd6c4-5e1f-425f-a590-6ed3a164ff62', '1cf5459a-5160-4f73-a855-647e2f1284cc'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:13 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:13 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:13 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333" returned: 0 in 0.879s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:13 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 is being set with open permissions: ugo+rw Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:13 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 Jul 01 07:05:13 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:13 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-1efefc41-be19-414a-b862-e7732dffb0c0" returned: 0 in 0.830s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-quobyte-1efefc41-be19-414a-b862-e7732dffb0c0" released by "delete_volume" :: held 1.983s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:13 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Created reservations ['924d12be-edee-4301-8004-51061ef678ab', 'b7124a9d-15a2-48bb-bae8-9eb5674529ea', '4b836e04-f33c-4259-af63-292d964f1698', '79fab85b-4aa4-4e3a-a8f7-5ed4cba34d92'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:14 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:14 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:14 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333" returned: 0 in 1.036s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:14 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info Jul 01 07:05:14 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:14 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.293s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Deleted volume successfully. Jul 01 07:05:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-44a4380c-607f-42d9-b410-ce684f3a056f tempest-VolumeAndVolumeTypeFromImageTest-517412996 None] Lock "cinder-58262606-925a-41e8-8958-f989fb0a4e63-delete_volume" released by "delete_volume" :: held 4.430s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:15 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.967s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:15 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:15 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Deleted volume successfully. Jul 01 07:05:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4c657e92-4459-4423-9a58-1116f3960245 tempest-CreateVolumesFromSourceVolumeTest-150168497 None] Lock "cinder-1efefc41-be19-414a-b862-e7732dffb0c0-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:15 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info" returned: 0 in 0.858s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:15 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info is being set with open permissions: ugo+rw Jul 01 07:05:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:15 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info Jul 01 07:05:15 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:16 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.info" returned: 0 in 0.989s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.103s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ea2acfad-bf02-4724-935a-85ddfb851aa0 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Create snapshot completed successfully Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Flow 'volume_create_manager' (d9e81d7c-9349-4db0-970e-9aa4b94df5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa574d8-7301-43ad-99cd-f45523e342ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa574d8-7301-43ad-99cd-f45523e342ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c903c049-ddab-48c8-913d-b9e271eedfbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2f38ad5a04b7fbe7acd00175478a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:17Z,use_quota=True,user_id='9b1081b975f5422dbd260a54879b06d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e525056d-8809-4dd5-9536-758ef997ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e525056d-8809-4dd5-9536-758ef997ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c187b1a2-6b0a-4089-b2a3-f0318f5e342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c187b1a2-6b0a-4089-b2a3-f0318f5e342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c903c049-ddab-48c8-913d-b9e271eedfbc', 'volume_name': 'volume-c903c049-ddab-48c8-913d-b9e271eedfbc', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be6cfa8-f983-4851-be84-7987a7f896d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be6cfa8-f983-4851-be84-7987a7f896d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821ba777-e7b3-4aab-bf63-b0e9be6ba4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Volume c903c049-ddab-48c8-913d-b9e271eedfbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c903c049-ddab-48c8-913d-b9e271eedfbc', 'volume_size': 1} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c903c049-ddab-48c8-913d-b9e271eedfbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2f38ad5a04b7fbe7acd00175478a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:17Z,use_quota=True,user_id='9b1081b975f5422dbd260a54879b06d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Creating volume c903c049-ddab-48c8-913d-b9e271eedfbc {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:17 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:17 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc 1073741824 Jul 01 07:05:17 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (f60b000e-83b1-4933-bf7b-0b47ecfac558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd92959d-84cb-40ef-9ab0-bd4b7a1dec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd92959d-84cb-40ef-9ab0-bd4b7a1dec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664108366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92d3ce9-cf86-4650-9127-715dbeeecc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:17Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7039868-969d-4e79-b931-e3c09275f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7039868-969d-4e79-b931-e3c09275f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cdc2d7-26f7-45ee-bb14-ec6cc5f86d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cdc2d7-26f7-45ee-bb14-ec6cc5f86d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92d3ce9-cf86-4650-9127-715dbeeecc03', 'volume_name': 'volume-f92d3ce9-cf86-4650-9127-715dbeeecc03', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e32a04d-d867-44c1-b858-a3d027c43794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e32a04d-d867-44c1-b858-a3d027c43794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ebba61-0529-4d94-a05f-5e36f669e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:17 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume f92d3ce9-cf86-4650-9127-715dbeeecc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92d3ce9-cf86-4650-9127-715dbeeecc03', 'volume_size': 1} Jul 01 07:05:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (6b1dcd62-a03f-4087-8708-e63d3481488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5443896a-ddca-4ebd-97e8-b66c47f2ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5443896a-ddca-4ebd-97e8-b66c47f2ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323133974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11003b9-0dcf-4822-9a46-bf9010fbead5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:18Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9e0706-bf2e-4cc7-8583-9fdcc6fc4f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9e0706-bf2e-4cc7-8583-9fdcc6fc4f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845e30bc-1a01-4185-880d-fb6e383fc720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845e30bc-1a01-4185-880d-fb6e383fc720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11003b9-0dcf-4822-9a46-bf9010fbead5', 'volume_name': 'volume-a11003b9-0dcf-4822-9a46-bf9010fbead5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6569546-f232-436f-bf78-285e18a25b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6569546-f232-436f-bf78-285e18a25b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76efa96-deae-475b-9889-f96daae3f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume a11003b9-0dcf-4822-9a46-bf9010fbead5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11003b9-0dcf-4822-9a46-bf9010fbead5', 'volume_size': 1} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:18 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc 1073741824" returned: 0 in 1.263s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:18 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc Jul 01 07:05:18 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (6bba6dd2-501e-4836-80f7-dc7feae094a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb17f261-5f94-4b74-858d-12d9cee9caa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb17f261-5f94-4b74-858d-12d9cee9caa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593166389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab9b482-2498-4047-8d01-810e16145eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:19Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51bcca6-c344-4238-a5d9-6721285a1dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51bcca6-c344-4238-a5d9-6721285a1dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8785f9-3f6e-4364-9463-8dc774b1e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8785f9-3f6e-4364-9463-8dc774b1e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab9b482-2498-4047-8d01-810e16145eb1', 'volume_name': 'volume-8ab9b482-2498-4047-8d01-810e16145eb1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e756e1-2084-4cf4-a4b9-fae0573c927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e756e1-2084-4cf4-a4b9-fae0573c927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8aa29e-ca57-4323-bc07-951b965ecb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:18 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume 8ab9b482-2498-4047-8d01-810e16145eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab9b482-2498-4047-8d01-810e16145eb1', 'volume_size': 1} Jul 01 07:05:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (0dc5ee87-60f9-4536-9428-4f057cd55268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf02f27-35a7-4564-b9ee-49230c48741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf02f27-35a7-4564-b9ee-49230c48741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564709959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acef9bd-239d-4fe7-bf77-09b9b0bebb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:19Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48efdc8-0af4-42b3-9b20-f071f2f00333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48efdc8-0af4-42b3-9b20-f071f2f00333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d2959-9dd5-4d0a-90ee-588690c7b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d2959-9dd5-4d0a-90ee-588690c7b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acef9bd-239d-4fe7-bf77-09b9b0bebb1a', 'volume_name': 'volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92992bb-c389-4991-b795-1ac96f0c9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92992bb-c389-4991-b795-1ac96f0c9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31741a20-92fe-46a7-b5c2-6e3b61899379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume 4acef9bd-239d-4fe7-bf77-09b9b0bebb1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a', 'volume_size': 1} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:19 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc" returned: 0 in 0.964s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664108366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92d3ce9-cf86-4650-9127-715dbeeecc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:17Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating volume f92d3ce9-cf86-4650-9127-715dbeeecc03 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:19 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821ba777-e7b3-4aab-bf63-b0e9be6ba4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c903c049-ddab-48c8-913d-b9e271eedfbc', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b59ceca-e1bf-4b01-8a13-f89fec6c8f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:19 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 1073741824 Jul 01 07:05:19 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:19 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Volume volume-c903c049-ddab-48c8-913d-b9e271eedfbc (c903c049-ddab-48c8-913d-b9e271eedfbc): created successfully Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b59ceca-e1bf-4b01-8a13-f89fec6c8f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:19 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Flow 'volume_create_manager' (d9e81d7c-9349-4db0-970e-9aa4b94df5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:19 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-5265c04f-e7b1-4a64-9f75-c93c091c5a06 tempest-CinderUnicodeTest-1638391590 None] Created volume successfully. Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (62490d3d-5744-4552-8fb9-5451b4286551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9da14e-8fa4-436c-8616-4c501608f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9da14e-8fa4-436c-8616-4c501608f04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607558168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bb4d04-c889-4f98-9acd-7f79849cefe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:20Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53474968-246e-4496-b787-1e5be7aad762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53474968-246e-4496-b787-1e5be7aad762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd0ce44-1b3d-46f0-bdb3-8919c70228af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd0ce44-1b3d-46f0-bdb3-8919c70228af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64bb4d04-c889-4f98-9acd-7f79849cefe7', 'volume_name': 'volume-64bb4d04-c889-4f98-9acd-7f79849cefe7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ff79ba-e6a7-4c7b-8538-405af8acad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ff79ba-e6a7-4c7b-8538-405af8acad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd740d02-59bf-4215-aead-499547578f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume 64bb4d04-c889-4f98-9acd-7f79849cefe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64bb4d04-c889-4f98-9acd-7f79849cefe7', 'volume_size': 1} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Flow 'volume_create_manager' (c46403cd-f034-4cd4-a892-0194ea1045d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7113d3-628d-4e11-86fe-5b18c1731e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7113d3-628d-4e11-86fe-5b18c1731e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-915954457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166da57b-dd1a-42a2-81b9-c8e9b7e9dda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e89d35ad214ae0a6ed4a941a3bdad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:21Z,use_quota=True,user_id='86b5805a318047b1b1433a1a117fd284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3bd041-a5bf-439b-82c6-1de66cf93535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3bd041-a5bf-439b-82c6-1de66cf93535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da446833-cf35-41c5-acd7-01c9500a2dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da446833-cf35-41c5-acd7-01c9500a2dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166da57b-dd1a-42a2-81b9-c8e9b7e9dda9', 'volume_name': 'volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6cc726-3d25-4a51-88e8-c03acc845401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6cc726-3d25-4a51-88e8-c03acc845401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add0656f-1709-4dbe-b8ee-abcddbb41848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:20 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Volume 166da57b-dd1a-42a2-81b9-c8e9b7e9dda9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9', 'volume_size': 1} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:20 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 1073741824" returned: 0 in 1.206s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:20 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:20 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 Jul 01 07:05:20 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Flow 'volume_create_manager' (39b3f632-3b0d-4610-aa42-c40fd74a621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807d6050-b320-453b-94f0-e0629a85e743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807d6050-b320-453b-94f0-e0629a85e743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1283704056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab428bf-b289-45d5-b1b3-2a0c2774880c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2f38ad5a04b7fbe7acd00175478a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:21Z,use_quota=True,user_id='9b1081b975f5422dbd260a54879b06d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f859db28-fb1c-4254-87dd-372eaee592fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f859db28-fb1c-4254-87dd-372eaee592fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f80b74-6f1e-4817-9e9f-cbdd149eca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f80b74-6f1e-4817-9e9f-cbdd149eca2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab428bf-b289-45d5-b1b3-2a0c2774880c', 'volume_name': 'volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fb651b-3be7-4ba8-99d0-361868fab6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fb651b-3be7-4ba8-99d0-361868fab6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d34859-73cf-46de-b525-4d3b79fd9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Volume 6ab428bf-b289-45d5-b1b3-2a0c2774880c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c', 'volume_size': 1} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:21 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03" returned: 0 in 0.755s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.381s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323133974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11003b9-0dcf-4822-9a46-bf9010fbead5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:18Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating volume a11003b9-0dcf-4822-9a46-bf9010fbead5 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:21 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ebba61-0529-4d94-a05f-5e36f669e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92d3ce9-cf86-4650-9127-715dbeeecc03', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:21 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 1073741824 Jul 01 07:05:21 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86204d5a-ca94-4d04-aac1-a5b7a27f6dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:21 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 (f92d3ce9-cf86-4650-9127-715dbeeecc03): created successfully Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86204d5a-ca94-4d04-aac1-a5b7a27f6dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:21 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (f60b000e-83b1-4933-bf7b-0b47ecfac558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:21 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f3ab2768-f6e6-425a-92ca-302b919f21e1 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created volume successfully. Jul 01 07:05:22 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 1073741824" returned: 0 in 0.912s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:22 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:22 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 Jul 01 07:05:22 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:23 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5" returned: 0 in 0.743s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.437s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593166389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab9b482-2498-4047-8d01-810e16145eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:19Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating volume 8ab9b482-2498-4047-8d01-810e16145eb1 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:23 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76efa96-deae-475b-9889-f96daae3f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11003b9-0dcf-4822-9a46-bf9010fbead5', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:23 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 1073741824 Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497844af-b7e5-4288-803e-5258dda70a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:23 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:23 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 (a11003b9-0dcf-4822-9a46-bf9010fbead5): created successfully Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497844af-b7e5-4288-803e-5258dda70a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:23 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (6b1dcd62-a03f-4087-8708-e63d3481488c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:23 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-75f31008-5cb8-4e2d-bc7f-1783990ead7b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created volume successfully. Jul 01 07:05:24 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 1073741824" returned: 0 in 1.098s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:24 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:24 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 Jul 01 07:05:24 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:25 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1" returned: 0 in 0.663s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.583s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564709959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acef9bd-239d-4fe7-bf77-09b9b0bebb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:19Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating volume 4acef9bd-239d-4fe7-bf77-09b9b0bebb1a {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:25 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:25 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a 1073741824 Jul 01 07:05:25 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8aa29e-ca57-4323-bc07-951b965ecb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab9b482-2498-4047-8d01-810e16145eb1', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088b483e-c4fa-4774-9203-eb2d77b6bd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:25 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume volume-8ab9b482-2498-4047-8d01-810e16145eb1 (8ab9b482-2498-4047-8d01-810e16145eb1): created successfully Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088b483e-c4fa-4774-9203-eb2d77b6bd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:25 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (6bba6dd2-501e-4836-80f7-dc7feae094a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:25 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2997d603-5239-4c93-9ff4-2073c0ea2ada tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created volume successfully. Jul 01 07:05:26 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a 1073741824" returned: 0 in 0.897s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:26 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a Jul 01 07:05:26 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:26 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:26 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:26 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a" returned: 0 in 0.720s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.552s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607558168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bb4d04-c889-4f98-9acd-7f79849cefe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33f6866e814d45933493a202b605dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:20Z,use_quota=True,user_id='1988040fa2514505868495ac2500c5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Creating volume 64bb4d04-c889-4f98-9acd-7f79849cefe7 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:26 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31741a20-92fe-46a7-b5c2-6e3b61899379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22abd7e-8e03-4c6e-9b32-2f721dc4c14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:26 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 1073741824 Jul 01 07:05:26 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:26 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a (4acef9bd-239d-4fe7-bf77-09b9b0bebb1a): created successfully Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22abd7e-8e03-4c6e-9b32-2f721dc4c14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:26 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (0dc5ee87-60f9-4536-9428-4f057cd55268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:26 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ed1d14ee-b446-4716-8d95-9644ef51c07a tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created volume successfully. Jul 01 07:05:27 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.776s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:05:27 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 1073741824" returned: 0 in 0.983s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:27 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 Jul 01 07:05:27 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:28 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7" returned: 0 in 0.753s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.782s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-915954457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166da57b-dd1a-42a2-81b9-c8e9b7e9dda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e89d35ad214ae0a6ed4a941a3bdad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:21Z,use_quota=True,user_id='86b5805a318047b1b1433a1a117fd284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Creating volume 166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:28 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:28 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 1073741824 Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd740d02-59bf-4215-aead-499547578f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64bb4d04-c889-4f98-9acd-7f79849cefe7', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:28 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d984d2-af41-4448-bfd0-ff91461da8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:28 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Volume volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 (64bb4d04-c889-4f98-9acd-7f79849cefe7): created successfully Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d984d2-af41-4448-bfd0-ff91461da8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Flow 'volume_create_manager' (62490d3d-5744-4552-8fb9-5451b4286551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:28 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-08364bd9-907d-410f-97c8-ba532b5b7b7f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created volume successfully. Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-64bb4d04-c889-4f98-9acd-7f79849cefe7-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-64bb4d04-c889-4f98-9acd-7f79849cefe7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-64bb4d04-c889-4f98-9acd-7f79849cefe7" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:28 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-64bb4d04-c889-4f98-9acd-7f79849cefe7" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:29 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[19124158-fd9a-4a14-a404-0215908a6e63]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:29 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 Jul 01 07:05:29 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:29 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 1073741824" returned: 0 in 1.080s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:29 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:29 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:29 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7" returned: 0 in 0.833s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:29 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:29 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7 Jul 01 07:05:29 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:30 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.835s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.374s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1283704056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab428bf-b289-45d5-b1b3-2a0c2774880c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2f38ad5a04b7fbe7acd00175478a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:21Z,use_quota=True,user_id='9b1081b975f5422dbd260a54879b06d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Creating volume 6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:30 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:30 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c 1073741824 Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add0656f-1709-4dbe-b8ee-abcddbb41848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:30 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa297195-627b-48d8-8679-8f1a52a35cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:30 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Volume volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 (166da57b-dd1a-42a2-81b9-c8e9b7e9dda9): created successfully Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa297195-627b-48d8-8679-8f1a52a35cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Flow 'volume_create_manager' (c46403cd-f034-4cd4-a892-0194ea1045d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:30 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-dfe7b6bb-8626-474d-a4a1-cd45e9fc73ba tempest-VolumeDependencyTests-95449959 None] Created volume successfully. Jul 01 07:05:30 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-64bb4d04-c889-4f98-9acd-7f79849cefe7" returned: 0 in 0.951s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-64bb4d04-c889-4f98-9acd-7f79849cefe7" released by "delete_volume" :: held 1.839s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['cf248982-b7cd-48cd-9b15-59285546c282', '15f4af84-b461-4ae0-acac-7bdfe8c79ed4', 'a7f78a9f-9662-4552-8d01-e3761166683f', 'c6231bb9-d6c0-4ab3-821c-938a537e9df9'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:30 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:30 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:30 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c47f21b-bfd8-4b35-b858-9ad7def36a49]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:31 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a Jul 01 07:05:31 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:31 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.967s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:31 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleted volume successfully. Jul 01 07:05:31 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c 1073741824" returned: 0 in 1.323s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-41faeda3-0eb4-411a-9b17-9fe386a3365b tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-64bb4d04-c889-4f98-9acd-7f79849cefe7-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:31 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:32 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c Jul 01 07:05:32 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:32 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a" returned: 0 in 0.982s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:32 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a Jul 01 07:05:32 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:32 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c" returned: 0 in 0.826s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.034s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Creating offline snapshot 449b0153-44ba-41ba-894c-cbe790e46bd7 of volume 166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d34859-73cf-46de-b525-4d3b79fd9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a059ff1b-1de4-43a4-be42-4064e899edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a0ba4-c62f-4677-8e52-a6301c2504a0]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:32 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Volume volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c (6ab428bf-b289-45d5-b1b3-2a0c2774880c): created successfully Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a059ff1b-1de4-43a4-be42-4064e899edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:32 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Flow 'volume_create_manager' (39b3f632-3b0d-4610-aa42-c40fd74a621c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:32 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-bc9ddaf1-423f-4922-8e4e-e7716f92b433 tempest-CinderUnicodeTest-1638391590 None] Created volume successfully. Jul 01 07:05:33 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:33 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:33 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a" returned: 0 in 0.779s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a" released by "delete_volume" :: held 1.817s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['225a7351-8bfc-43bb-b25a-4baff2db6b27', 'e116c666-9c10-4be1-85c9-bdb4824112be', '14d181e8-135f-4495-bec0-6512c1bdc1a6', '2a5050d7-b8a0-4646-9738-7c455275ce50'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:33 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:33 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-8ab9b482-2498-4047-8d01-810e16145eb1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-8ab9b482-2498-4047-8d01-810e16145eb1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-8ab9b482-2498-4047-8d01-810e16145eb1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-8ab9b482-2498-4047-8d01-810e16145eb1" acquired by "delete_volume" :: waited 0.037s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7962d18-176b-43bc-8c3f-cb06c0f139c6]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:33 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 Jul 01 07:05:33 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:33 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.925s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:33 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:33 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 1G Jul 01 07:05:33 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:34 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.767s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:34 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleted volume successfully. Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1d4c0aba-9f2c-486a-9275-0dc685177d35 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-4acef9bd-239d-4fe7-bf77-09b9b0bebb1a-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:34 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1" returned: 0 in 0.977s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:34 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1 Jul 01 07:05:34 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:34 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 1G" returned: 0 in 0.930s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:34 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:34 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 Jul 01 07:05:34 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:35 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-8ab9b482-2498-4047-8d01-810e16145eb1" returned: 0 in 0.739s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-8ab9b482-2498-4047-8d01-810e16145eb1" released by "delete_volume" :: held 1.772s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['a4085427-c0d4-42c4-8c9a-adcb7cb07f09', '1b79b94f-0a01-40db-9739-7d8b823a386e', '2cc557ed-1354-4a90-a22a-9ac9279d472c', 'b21734ff-f857-433b-86ce-5c0531f3377f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:35 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:35 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:35 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7" returned: 0 in 0.809s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:35 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 is being set with open permissions: ugo+rw Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:35 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 Jul 01 07:05:35 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-a11003b9-0dcf-4822-9a46-bf9010fbead5-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-a11003b9-0dcf-4822-9a46-bf9010fbead5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-a11003b9-0dcf-4822-9a46-bf9010fbead5" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:35 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-a11003b9-0dcf-4822-9a46-bf9010fbead5" acquired by "delete_volume" :: waited 0.041s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0065d51f-34c5-41a2-8275-7ca84226ab88]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:36 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 Jul 01 07:05:36 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:36 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7" returned: 0 in 1.051s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=134,cinder:UPDATE=191,cinder:INSERT=57,cinder:DELETE=19 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:05:36 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.118s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:36 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleted volume successfully. Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0ef25cde-2bd3-45e8-980d-264d204b8d85 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-8ab9b482-2498-4047-8d01-810e16145eb1-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:36 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info Jul 01 07:05:36 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:36 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5" returned: 0 in 0.895s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:36 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:36 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5 Jul 01 07:05:37 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:37 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info" returned: 0 in 0.674s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:37 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info is being set with open permissions: ugo+rw Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:37 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info Jul 01 07:05:37 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:37 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-a11003b9-0dcf-4822-9a46-bf9010fbead5" returned: 0 in 0.828s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-a11003b9-0dcf-4822-9a46-bf9010fbead5" released by "delete_volume" :: held 1.833s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['f0349c84-bc4c-4385-8ef7-75e31d0bedf1', '2ac9c730-0b6c-4804-9365-0f0817c3cc1a', '8947b809-669e-4167-b775-4e91653fd67f', 'c06bac37-94ea-477f-b64c-47f9b479c491'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:37 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:37 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:37 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-f92d3ce9-cf86-4650-9127-715dbeeecc03-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-f92d3ce9-cf86-4650-9127-715dbeeecc03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-f92d3ce9-cf86-4650-9127-715dbeeecc03" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-f92d3ce9-cf86-4650-9127-715dbeeecc03" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1ea5c-0b3a-4944-a7e7-13e9626524f5]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:38 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.info" returned: 0 in 1.051s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:38 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 Jul 01 07:05:38 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.622s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.056s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Creating offline snapshot 2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 of volume 6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 07:05:38 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-054d067b-dc93-4587-9c2d-e83c086cba09 tempest-VolumeDependencyTests-95449959 None] Create snapshot completed successfully Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd807957-971f-4daf-ab9e-c899cb1ebc6f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:38 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c Jul 01 07:05:38 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:38 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.846s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:38 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleted volume successfully. Jul 01 07:05:38 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-68aacf26-b525-4c21-977d-5e710d86d4ff tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-a11003b9-0dcf-4822-9a46-bf9010fbead5-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:39 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03" returned: 0 in 0.946s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:39 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03 Jul 01 07:05:39 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:39 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c" returned: 0 in 1.047s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:39 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:39 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 1G Jul 01 07:05:39 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:39 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Flow 'volume_create_manager' (c6cff4af-15b0-47b0-b83a-c53c0ebc5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d7ceb3-c7a0-4d25-ae4f-acbbba321133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=159,cinder:UPDATE=219,cinder:INSERT=51,cinder:DELETE=21 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d7ceb3-c7a0-4d25-ae4f-acbbba321133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-254886275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c36e4db-a8bb-4153-9d33-272e5295b495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e89d35ad214ae0a6ed4a941a3bdad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=449b0153-44ba-41ba-894c-cbe790e46bd7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:40Z,use_quota=True,user_id='86b5805a318047b1b1433a1a117fd284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a03385d-f6b6-46f4-86dc-83f535e4b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a03385d-f6b6-46f4-86dc-83f535e4b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef0c7c3-1acc-4b89-a2b6-7bbc3a0c1290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef0c7c3-1acc-4b89-a2b6-7bbc3a0c1290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c36e4db-a8bb-4153-9d33-272e5295b495', 'volume_name': 'volume-4c36e4db-a8bb-4153-9d33-272e5295b495', 'volume_size': 1, 'snapshot_id': '449b0153-44ba-41ba-894c-cbe790e46bd7'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72b628d-a72a-43a7-96cf-0364c950994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72b628d-a72a-43a7-96cf-0364c950994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd75250-9607-497d-9658-9fdb6fbe53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:40 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Volume 4c36e4db-a8bb-4153-9d33-272e5295b495: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c36e4db-a8bb-4153-9d33-272e5295b495', 'volume_size': 1, 'snapshot_id': '449b0153-44ba-41ba-894c-cbe790e46bd7'} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:40 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f92d3ce9-cf86-4650-9127-715dbeeecc03" returned: 0 in 0.887s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-f92d3ce9-cf86-4650-9127-715dbeeecc03" released by "delete_volume" :: held 1.880s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['648d4e81-484a-479f-bbb7-56b366a2450c', '1f417871-1f90-401f-a35f-e495b130fc7d', '7d4eef68-2e6a-42ad-96c2-75cea3802800', 'd49960ba-b320-4f8f-a5cc-a502b82776a8'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:40 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:40 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-249592bc-c50f-4ba7-a48b-e6a4d0ea7333-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-249592bc-c50f-4ba7-a48b-e6a4d0ea7333-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-249592bc-c50f-4ba7-a48b-e6a4d0ea7333" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-249592bc-c50f-4ba7-a48b-e6a4d0ea7333" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleting offline snapshot 249592bc-c50f-4ba7-a48b-e6a4d0ea7333 of volume 84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] snapshot_file for this snap is: volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8f0a02-f3b6-46eb-90ab-a02124ddfa24]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:40 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 1G" returned: 0 in 1.172s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:40 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:40 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 Jul 01 07:05:40 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:40 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 Jul 01 07:05:40 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:41 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.821s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:41 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleted volume successfully. Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-9ef5b3e6-b6a8-4c4b-949a-160c723abb18 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-f92d3ce9-cf86-4650-9127-715dbeeecc03-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:41 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:41 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333" returned: 0 in 0.990s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" returned: 0 in 0.871s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:41 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 is being set with open permissions: ugo+rw Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7340668c-bdf3-4238-9da4-89ed013ea73d]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:41 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:41 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 Jul 01 07:05:41 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:41 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 Jul 01 07:05:41 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:42 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" returned: 0 in 0.779s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:42 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info Jul 01 07:05:42 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:42 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" returned: 0 in 0.917s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:42 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:42 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 Jul 01 07:05:42 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:43 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info" returned: 0 in 0.713s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:43 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info is being set with open permissions: ugo+rw Jul 01 07:05:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:43 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info Jul 01 07:05:43 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:43 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333" returned: 0 in 0.826s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:43 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:43 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333 Jul 01 07:05:43 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:43 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.info" returned: 0 in 0.864s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.583s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.908s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-quobyte-449b0153-44ba-41ba-894c-cbe790e46bd7-4c36e4db-a8bb-4153-9d33-272e5295b495" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-449b0153-44ba-41ba-894c-cbe790e46bd7-4c36e4db-a8bb-4153-9d33-272e5295b495" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Creating volume 4c36e4db-a8bb-4153-9d33-272e5295b495 from snapshot 449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-quobyte-4c36e4db-a8bb-4153-9d33-272e5295b495" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ff1013e9-396a-4db3-a30d-2c1df969217c tempest-CinderUnicodeTest-1638391590 None] Create snapshot completed successfully Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-4c36e4db-a8bb-4153-9d33-272e5295b495" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] snapshot: 449b0153-44ba-41ba-894c-cbe790e46bd7, volume: 4c36e4db-a8bb-4153-9d33-272e5295b495, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef571c-2459-4437-adfc-716046c0156e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:44 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1.249592bc-c50f-4ba7-a48b-e6a4d0ea7333" returned: 0 in 0.832s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-249592bc-c50f-4ba7-a48b-e6a4d0ea7333" released by "_delete_snapshot" :: held 3.706s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" released by "delete_snapshot" :: held 3.739s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:44 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 Jul 01 07:05:44 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['4eae5843-9105-4bff-a6e4-b8bb1362878f', 'd6f042e7-0325-4925-a577-cb89ad782c44', '4cfb8ce9-4a0b-4114-8b49-10d2edcc29b8', '65b7ab92-7c51-42ff-9510-64a5e36b649f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:44 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Delete snapshot completed successfully. Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4845e4bf-9e6a-4048-8f5f-650edcd7744f tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-249592bc-c50f-4ba7-a48b-e6a4d0ea7333-delete_snapshot" released by "delete_snapshot" :: held 3.917s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "cinder-quobyte-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8f96d-bb73-49a0-9a2d-d261e4abb8de]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:44 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:45 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 Jul 01 07:05:45 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-quobyte-6ab428bf-b289-45d5-b1b3-2a0c2774880c" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-6ab428bf-b289-45d5-b1b3-2a0c2774880c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-quobyte-2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Deleting offline snapshot 2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 of volume 6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 07:05:45 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] snapshot_file for this snap is: volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7" returned: 0 in 0.979s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f2fafc-2bc7-47d5-9f4f-46920922ddad]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[86de8814-fb92-462b-b53d-10490eff1987]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Flow 'volume_create_manager' (8794c4f1-602e-45e6-8ad5-0b30a0c9593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa099b4-9384-4621-9b5b-a904193bc739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa099b4-9384-4621-9b5b-a904193bc739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1634583795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0235ec5-3e8c-44b9-a396-60fca5604d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4b31fd15a04dc2a948eed5ff007657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:45Z,use_quota=True,user_id='48c6d2dafe384e90abe74c04aa5bd99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4685d65-768d-4c1c-8f94-3f1d4aaf0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4685d65-768d-4c1c-8f94-3f1d4aaf0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a297df-c521-4742-b7d3-ad292699436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a297df-c521-4742-b7d3-ad292699436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0235ec5-3e8c-44b9-a396-60fca5604d35', 'volume_name': 'volume-f0235ec5-3e8c-44b9-a396-60fca5604d35', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444fdf3e-45c5-4d06-8b5f-dd79b415a7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444fdf3e-45c5-4d06-8b5f-dd79b415a7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461f48ab-b6fd-4de2-8823-b1369943d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:45 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Volume f0235ec5-3e8c-44b9-a396-60fca5604d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0235ec5-3e8c-44b9-a396-60fca5604d35', 'volume_size': 1} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:45 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:45 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:45 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 Jul 01 07:05:45 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:45 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" returned: 0 in 0.861s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:45 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:45 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1 Jul 01 07:05:45 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:46 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.874s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:46 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" returned: 0 in 0.918s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:05:46 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 Jul 01 07:05:46 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c4636-6443-4545-a527-41801c12fed7]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:46 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c Jul 01 07:05:46 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:46 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" returned: 0 in 0.730s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-quobyte-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1" released by "delete_volume" :: held 1.683s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Created reservations ['3871721b-f5f5-448e-a8cf-c4a6cfc9852e', '93ba561f-b620-4347-a995-16a246a7d74e', '8e189aa9-b6f0-4ffa-8f2b-c6d54cb88076', '400c0caa-8023-41a3-b35c-f17017b6ee12'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:46 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:46 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:46 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:47 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c" returned: 0 in 1.021s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:47 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:47 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 Jul 01 07:05:47 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:48 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:48 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 1.592s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:48 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:48 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Deleted volume successfully. Jul 01 07:05:48 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-504f65a5-7d0d-4312-b605-30ab1ffd62d2 tempest-CreateVolumesFromSnapshotTest-1215182057 None] Lock "cinder-84fbb6ab-0e49-426e-bf1f-d62cc2fe83e1-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:49 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" returned: 0 in 2.328s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:49 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:49 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4 Jul 01 07:05:49 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:50 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:50 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c.2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" returned: 0 in 1.206s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4" released by "_delete_snapshot" :: held 5.669s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:50 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-6ab428bf-b289-45d5-b1b3-2a0c2774880c" released by "delete_snapshot" :: held 5.711s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:51 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Created reservations ['0c04149f-fd89-4a6b-a625-4bd91fe9ca17', '16c15c51-4c4b-4f94-843f-3d4de8aa946a', '5ebf1cc5-ed5c-4800-af4e-b8dbaee3f1b6', '9d157b9a-93e2-4d65-9d7d-de1df719bf8f'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:51 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Delete snapshot completed successfully. Jul 01 07:05:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-f66d6905-942e-4b64-bddd-a54fecf7f628 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-2b040dbf-17ef-4da4-ba5f-ad7fb46e3fd4-delete_snapshot" released by "delete_snapshot" :: held 6.182s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-6ab428bf-b289-45d5-b1b3-2a0c2774880c-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-6ab428bf-b289-45d5-b1b3-2a0c2774880c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-quobyte-6ab428bf-b289-45d5-b1b3-2a0c2774880c" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:51 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-6ab428bf-b289-45d5-b1b3-2a0c2774880c" acquired by "delete_volume" :: waited 0.052s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[89844c09-7bb4-43af-b114-3ad1fa84d8ec]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:52 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c Jul 01 07:05:52 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:52 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495" returned: 0 in 6.154s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206f477-6631-416f-80c0-dd887caa2c65]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:52 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:52 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:52 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c" returned: 0 in 0.794s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:52 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:52 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c Jul 01 07:05:52 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:53 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.937s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:05:53 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Converted 1024.00 MB image at 166.37 MB/s Jul 01 07:05:53 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 is being set with open permissions: ugo+rw Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:53 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 Jul 01 07:05:53 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:53 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-6ab428bf-b289-45d5-b1b3-2a0c2774880c" returned: 0 in 0.658s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-6ab428bf-b289-45d5-b1b3-2a0c2774880c" released by "delete_volume" :: held 1.572s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Created reservations ['53e4561e-f284-4265-931a-c204bae5eb1c', '2e76e909-09a7-4517-87d0-1eee3de4da3e', 'd73bae64-edbb-4c2a-aa62-bb8e379dfdfc', 'bb2e7909-7317-46a4-a973-e345db9976cf'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:53 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:53 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:53 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495" returned: 0 in 0.636s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-4c36e4db-a8bb-4153-9d33-272e5295b495" released by "_copy_volume_from_snapshot" :: held 9.712s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-449b0153-44ba-41ba-894c-cbe790e46bd7-4c36e4db-a8bb-4153-9d33-272e5295b495" released by "_create_volume_from_snapshot" :: held 9.762s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.794s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.523s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1634583795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0235ec5-3e8c-44b9-a396-60fca5604d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4b31fd15a04dc2a948eed5ff007657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:05:45Z,use_quota=True,user_id='48c6d2dafe384e90abe74c04aa5bd99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)}" {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Creating volume f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:05:53 devstack cinder-volume[86219]: INFO cinder.volume.drivers.remotefs [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] casted to osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 1073741824 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:53 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 1073741824 Jul 01 07:05:53 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd75250-9607-497d-9658-9fdb6fbe53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c36e4db-a8bb-4153-9d33-272e5295b495', 'volume_size': 1, 'snapshot_id': '449b0153-44ba-41ba-894c-cbe790e46bd7'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdb0718-19ae-49ff-99f0-3251f082e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:53 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Volume volume-4c36e4db-a8bb-4153-9d33-272e5295b495 (4c36e4db-a8bb-4153-9d33-272e5295b495): created successfully Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdb0718-19ae-49ff-99f0-3251f082e274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:53 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Flow 'volume_create_manager' (c6cff4af-15b0-47b0-b83a-c53c0ebc5201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:53 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-822e9ae4-04c1-4beb-9579-d959451fb4f6 tempest-VolumeDependencyTests-95449959 None] Created volume successfully. Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-c903c049-ddab-48c8-913d-b9e271eedfbc-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-c903c049-ddab-48c8-913d-b9e271eedfbc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "cinder-quobyte-c903c049-ddab-48c8-913d-b9e271eedfbc" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-c903c049-ddab-48c8-913d-b9e271eedfbc" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba84c8e-3313-4b6a-b9a0-c0da959f9a1f]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-449b0153-44ba-41ba-894c-cbe790e46bd7-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-449b0153-44ba-41ba-894c-cbe790e46bd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-quobyte-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-quobyte-449b0153-44ba-41ba-894c-cbe790e46bd7" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-449b0153-44ba-41ba-894c-cbe790e46bd7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:54 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Deleting offline snapshot 449b0153-44ba-41ba-894c-cbe790e46bd7 of volume 166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] snapshot_file for this snap is: volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.811s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:54 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc Jul 01 07:05:54 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:54 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Deleted volume successfully. Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be9a23-bfa3-4c49-a92a-991cea36ba1c]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:54 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 Jul 01 07:05:54 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-ca37993b-6d21-40af-84c8-835ceb4bc4e5 tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-6ab428bf-b289-45d5-b1b3-2a0c2774880c-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:54 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 1073741824" returned: 0 in 0.959s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:54 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:54 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:05:54 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:55 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc" returned: 0 in 0.829s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:55 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc Jul 01 07:05:55 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:55 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7" returned: 0 in 0.830s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[016bcec9-fd7e-4dde-9cfb-cac212c8c957]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:55 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:55 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:55 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.767s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'} {{(pid=86219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461f48ab-b6fd-4de2-8823-b1369943d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0235ec5-3e8c-44b9-a396-60fca5604d35', 'volume_size': 1}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9702ac-a0cb-4548-bddb-e337718061fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:05:55 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Volume volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 (f0235ec5-3e8c-44b9-a396-60fca5604d35): created successfully Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9702ac-a0cb-4548-bddb-e337718061fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Flow 'volume_create_manager' (8794c4f1-602e-45e6-8ad5-0b30a0c9593d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:05:55 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-edfa1ebf-8a25-4010-942c-5f07377daf86 tempest-SnapshotDependencyTests-1179665855 None] Created volume successfully. Jul 01 07:05:55 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-c903c049-ddab-48c8-913d-b9e271eedfbc" returned: 0 in 0.664s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-quobyte-c903c049-ddab-48c8-913d-b9e271eedfbc" released by "delete_volume" :: held 1.543s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Created reservations ['209d2eda-bfb4-414a-bc3e-bd6d7683a9e0', 'f4a9071f-bce9-4014-bfd6-aaa451fab89e', '3fcd1028-79d3-42fc-9399-531ed16e58dd', '206d8b4e-2314-46aa-8cea-426783f99618'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:05:55 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:55 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:05:55 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:56 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.870s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:56 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 Jul 01 07:05:56 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Creating offline snapshot 78743357-2c4a-457d-a050-3719160d0011 of volume f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 07:05:56 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.734s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b477fae4-8b19-4339-a619-f8a96ecd680e]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:56 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Deleted volume successfully. Jul 01 07:05:56 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-0a12c314-e82a-422f-a3f1-a3034d3dca1b tempest-CinderUnicodeTest-1638391590 None] Lock "cinder-c903c049-ddab-48c8-913d-b9e271eedfbc-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:56 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:05:56 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:57 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7" returned: 0 in 0.878s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:57 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7 Jul 01 07:05:57 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:57 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.949s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 1G {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:57 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 1G Jul 01 07:05:57 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:57 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9.449b0153-44ba-41ba-894c-cbe790e46bd7" returned: 0 in 0.755s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-449b0153-44ba-41ba-894c-cbe790e46bd7" released by "_delete_snapshot" :: held 3.479s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:57 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" released by "delete_snapshot" :: held 3.504s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Created reservations ['5906cc06-56cc-4d4e-aba9-fcde8f453a42', '4d6b432c-8458-4fcd-b26b-12f61f6902db', '4636553c-79c8-4af1-8e43-7bd122dd2bcb', '66da8720-3b4e-471a-9834-eac5a4ce0c22'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:05:58 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Delete snapshot completed successfully. Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-1fb66cfb-1dd3-453c-a49f-fc57006f8701 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-449b0153-44ba-41ba-894c-cbe790e46bd7-delete_snapshot" released by "delete_snapshot" :: held 3.698s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:05:58 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 1G" returned: 0 in 0.868s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:58 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 Jul 01 07:05:58 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-quobyte-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[978df546-b27e-4a09-9fff-b3eeb362788a]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:05:58 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:58 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:58 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:59 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 -F qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011" returned: 0 in 0.698s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:59 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 is being set with open permissions: ugo+rw Jul 01 07:05:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:59 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 Jul 01 07:05:59 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:59 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.791s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:59 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9 Jul 01 07:05:59 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:05:59 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 01 07:05:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011" returned: 0 in 0.642s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:05:59 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:05:59 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info Jul 01 07:05:59 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:00 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" returned: 0 in 0.672s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9" released by "delete_volume" :: held 1.537s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Created reservations ['b6053077-7940-49ff-8266-be36f00f4029', 'fea8e6e9-1cde-4907-a983-84cd7049a555', '29d41c37-e8bb-4dd8-877c-6eaa03be0af1', 'e877b05e-494f-4bfc-9984-917cf29949b5'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:00 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:06:00 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:00 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info" returned: 0 in 0.670s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:00 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info is being set with open permissions: ugo+rw Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:00 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info Jul 01 07:06:00 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-4c36e4db-a8bb-4153-9d33-272e5295b495-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Lock "cinder-4c36e4db-a8bb-4153-9d33-272e5295b495-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:00 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Acquiring lock "cinder-quobyte-4c36e4db-a8bb-4153-9d33-272e5295b495" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-4c36e4db-a8bb-4153-9d33-272e5295b495" acquired by "delete_volume" :: waited 0.021s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edcee22-6a56-416b-8f08-46dbf88bb3de]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:01 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.702s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:06:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Deleted volume successfully. Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-4339da29-93e5-41c8-a7aa-3155139ecea7 tempest-VolumeDependencyTests-95449959 None] Lock "cinder-166da57b-dd1a-42a2-81b9-c8e9b7e9dda9-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:01 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 Jul 01 07:06:01 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:01 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.info" returned: 0 in 0.665s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.598s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:01 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-e5ded4b5-1425-4ea8-8fdd-605d66e939ae tempest-SnapshotDependencyTests-1179665855 None] Create snapshot completed successfully Jul 01 07:06:01 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495" returned: 0 in 0.779s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:01 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:01 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495 Jul 01 07:06:01 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 07:06:02 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Flow 'volume_create_manager' (c3946f2e-99fd-4c5e-922b-819b5eda4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999cc899-e9ac-4d69-a344-a301d206d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-4c36e4db-a8bb-4153-9d33-272e5295b495" returned: 0 in 0.670s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999cc899-e9ac-4d69-a344-a301d206d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T05:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7387470e-8cbe-4d96-a60d-e94b403821c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4b31fd15a04dc2a948eed5ff007657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T05:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78743357-2c4a-457d-a050-3719160d0011,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T05:06:02Z,use_quota=True,user_id='48c6d2dafe384e90abe74c04aa5bd99f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2803ba93-2f30-40d4-96f1-0e4a62d9adce),volume_type_id=2803ba93-2f30-40d4-96f1-0e4a62d9adce)' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e035aa-45fd-4e7b-a573-274cef88eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e035aa-45fd-4e7b-a573-274cef88eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e60d5c-5aae-45e3-a930-0f2a599162a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e60d5c-5aae-45e3-a930-0f2a599162a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7387470e-8cbe-4d96-a60d-e94b403821c8', 'volume_name': 'volume-7387470e-8cbe-4d96-a60d-e94b403821c8', 'volume_size': 1, 'snapshot_id': '78743357-2c4a-457d-a050-3719160d0011'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caaf352a-ca2b-4382-b960-4edd39d3c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caaf352a-ca2b-4382-b960-4edd39d3c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9d3edf-1bfa-4574-bafd-58f805f5f82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:06:02 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Volume 7387470e-8cbe-4d96-a60d-e94b403821c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7387470e-8cbe-4d96-a60d-e94b403821c8', 'volume_size': 1, 'snapshot_id': '78743357-2c4a-457d-a050-3719160d0011'} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Lock "cinder-quobyte-4c36e4db-a8bb-4153-9d33-272e5295b495" released by "delete_volume" :: held 1.539s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-quobyte-78743357-2c4a-457d-a050-3719160d0011-7387470e-8cbe-4d96-a60d-e94b403821c8" by "_create_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-78743357-2c4a-457d-a050-3719160d0011-7387470e-8cbe-4d96-a60d-e94b403821c8" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Creating volume 7387470e-8cbe-4d96-a60d-e94b403821c8 from snapshot 78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Selected osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313 as target Quobyte volume. {{(pid=86219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-quobyte-7387470e-8cbe-4d96-a60d-e94b403821c8" by "_copy_volume_from_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-7387470e-8cbe-4d96-a60d-e94b403821c8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] snapshot: 78743357-2c4a-457d-a050-3719160d0011, volume: 7387470e-8cbe-4d96-a60d-e94b403821c8, {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Created reservations ['a5855a70-4635-4b27-8f24-8172bb5be613', '65e85517-a7e5-4d4c-a30c-cd4f0250fe28', 'c3330993-6ff7-4868-860f-4f2ad5bec3b9', '486981a0-3416-44ea-86f7-e741fe928679'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0104b1d-bd96-48d2-aae3-df7622513dcd]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:02 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:02 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:06:02 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:02 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 Jul 01 07:06:02 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:03 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.682s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:06:03 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Deleted volume successfully. Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-2491fe3b-4b7b-4551-9f6e-99e480cb9acb tempest-VolumeDependencyTests-95449959 None] Lock "cinder-4c36e4db-a8bb-4153-9d33-272e5295b495-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:03 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011" returned: 0 in 0.836s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0235ec5-3e8c-44b9-a396-60fca5604d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Creating direct copy from snapshot {{(pid=86219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[716aa154-b557-4328-8ea7-70644677cb27]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:03 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:03 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:06:03 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.799s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:04 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:04 devstack cinder-volume[86219]: DEBUG cinder.utils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Path /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 not found in is_blk_device check {{(pid=86219) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 07:06:04 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:04 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 Jul 01 07:06:04 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:08 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8" returned: 0 in 4.270s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:08 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e21da9-98e4-46f6-ad2b-eebf344660a1]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:08 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:08 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:06:08 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:09 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.904s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:09 devstack cinder-volume[86219]: DEBUG cinder.image.image_utils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Image conversion details: src /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 {{(pid=86219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 07:06:09 devstack cinder-volume[86219]: INFO cinder.image.image_utils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Converted 1024.00 MB image at 239.77 MB/s Jul 01 07:06:09 devstack cinder-volume[86219]: WARNING cinder.volume.drivers.remotefs [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 is being set with open permissions: ugo+rw Jul 01 07:06:09 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:09 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 Jul 01 07:06:09 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:10 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8" returned: 0 in 0.619s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-7387470e-8cbe-4d96-a60d-e94b403821c8" released by "_copy_volume_from_snapshot" :: held 7.523s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-78743357-2c4a-457d-a050-3719160d0011-7387470e-8cbe-4d96-a60d-e94b403821c8" released by "_create_volume_from_snapshot" :: held 7.553s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.573s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9d3edf-1bfa-4574-bafd-58f805f5f82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7387470e-8cbe-4d96-a60d-e94b403821c8', 'volume_size': 1, 'snapshot_id': '78743357-2c4a-457d-a050-3719160d0011'}' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329827f8-a43b-4076-b7c2-6b1176224334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 07:06:10 devstack cinder-volume[86219]: INFO cinder.volume.flows.manager.create_volume [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Volume volume-7387470e-8cbe-4d96-a60d-e94b403821c8 (7387470e-8cbe-4d96-a60d-e94b403821c8): created successfully Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329827f8-a43b-4076-b7c2-6b1176224334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86219) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 07:06:10 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Flow 'volume_create_manager' (c3946f2e-99fd-4c5e-922b-819b5eda4310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86219) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 07:06:10 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-7a17545e-76cf-4653-9033-7e09a84293fe tempest-SnapshotDependencyTests-1179665855 None] Created volume successfully. Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-78743357-2c4a-457d-a050-3719160d0011-delete_snapshot" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-78743357-2c4a-457d-a050-3719160d0011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-quobyte-f0235ec5-3e8c-44b9-a396-60fca5604d35" by "delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-f0235ec5-3e8c-44b9-a396-60fca5604d35" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-quobyte-78743357-2c4a-457d-a050-3719160d0011" by "_delete_snapshot" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-78743357-2c4a-457d-a050-3719160d0011" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Deleting offline snapshot 78743357-2c4a-457d-a050-3719160d0011 of volume f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] snapshot_file for this snap is: volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f3e30-3965-4017-9392-aa006779f5c2]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:11 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 Jul 01 07:06:11 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:11 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011" returned: 0 in 0.727s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.remotefs [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0235ec5-3e8c-44b9-a396-60fca5604d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eedfcb-303c-4058-8570-e0f88b408fb8]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:11 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:12 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:06:12 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:12 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.712s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:12 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:12 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 Jul 01 07:06:12 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:13 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011" returned: 0 in 0.697s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:13 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011 Jul 01 07:06:13 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:13 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:13 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35.78743357-2c4a-457d-a050-3719160d0011" returned: 0 in 0.621s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-78743357-2c4a-457d-a050-3719160d0011" released by "_delete_snapshot" :: held 2.853s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-f0235ec5-3e8c-44b9-a396-60fca5604d35" released by "delete_snapshot" :: held 2.876s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Created reservations ['8f6360ba-0f92-481c-aae5-fc9349e86889', 'dc169ccf-e901-487a-84de-dec46c83670a', 'd9c35b2d-775d-4739-bd21-34a15260fef2', 'c48ed9ea-0e1b-42d7-8cf5-ee4db16ad059'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:06:14 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Delete snapshot completed successfully. Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-73381181-0fbd-4ced-bf5d-8776d470955b tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-78743357-2c4a-457d-a050-3719160d0011-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-f0235ec5-3e8c-44b9-a396-60fca5604d35-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-f0235ec5-3e8c-44b9-a396-60fca5604d35-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-quobyte-f0235ec5-3e8c-44b9-a396-60fca5604d35" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-f0235ec5-3e8c-44b9-a396-60fca5604d35" acquired by "delete_volume" :: waited 0.012s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0acfeb5-f6a1-4e95-93eb-d05e7dd055ed]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:14 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:14 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:06:14 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:15 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.765s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:15 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35 Jul 01 07:06:15 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:15 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-f0235ec5-3e8c-44b9-a396-60fca5604d35" returned: 0 in 0.632s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-f0235ec5-3e8c-44b9-a396-60fca5604d35" released by "delete_volume" :: held 1.451s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Created reservations ['bdb37a4e-01d3-47c7-b9cb-78250ca995c2', '0276a0c5-4005-451e-95d3-ac3a376f8b98', 'e694cf8c-1caf-4550-a44b-2e35b3816007', '0af36a6f-4fad-4bce-b637-cd0b7dc8cc03'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:15 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:15 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:06:15 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-7387470e-8cbe-4d96-a60d-e94b403821c8-delete_volume" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-7387470e-8cbe-4d96-a60d-e94b403821c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:16 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.628s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:06:16 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Deleted volume successfully. Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "cinder-quobyte-7387470e-8cbe-4d96-a60d-e94b403821c8" by "delete_volume" {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-af589c32-c39d-4839-bd61-b508c5537ec5 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-f0235ec5-3e8c-44b9-a396-60fca5604d35-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-7387470e-8cbe-4d96-a60d-e94b403821c8" acquired by "delete_volume" :: waited 0.022s {{(pid=86219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb52f8-7051-416a-89e1-3102d60e7de0]: (4, 'qcow2') {{(pid=87314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 07:06:16 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:16 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 Jul 01 07:06:16 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:17 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8" returned: 0 in 0.753s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:17 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:17 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8 Jul 01 07:06:17 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:18 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4/volume-7387470e-8cbe-4d96-a60d-e94b403821c8" returned: 0 in 0.632s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-quobyte-7387470e-8cbe-4d96-a60d-e94b403821c8" released by "delete_volume" :: held 1.421s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG cinder.quota [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Created reservations ['954c082e-4e15-456c-bb48-36eee5f6113c', 'b65e946c-2565-45da-be7d-53f92da9f488', '0de70928-3876-47fb-b306-a8526e091fa2', 'd2a52af6-5f11-46cd-96da-5865c93ee98a'] {{(pid=86219) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:18 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:06:18 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:18 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.626s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:06:18 devstack cinder-volume[86219]: INFO cinder.volume.manager [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Deleted volume successfully. Jul 01 07:06:18 devstack cinder-volume[86219]: DEBUG cinder.coordination [None req-c402115a-5164-49e0-961e-323b50b711e3 tempest-SnapshotDependencyTests-1179665855 None] Lock "cinder-7387470e-8cbe-4d96-a60d-e94b403821c8-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86219) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313': None} {{(pid=86219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG cinder.volume.drivers.quobyte [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c07f1ed-b168-4621-b661-8f454f8ea313'] {{(pid=86219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.lockutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86219) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 07:06:26 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 07:06:26 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4 Jul 01 07:06:26 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 07:06:27 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 01 07:06:27 devstack cinder-volume[86219]: DEBUG oslo_concurrency.processutils [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/113842eea4d1dc7cd4afc8d9ed72c1b4" returned: 0 in 0.645s {{(pid=86219) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 07:06:27 devstack cinder-volume[86219]: DEBUG cinder.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Notifying Schedulers of capabilities ... {{(pid=86219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 07:06:27 devstack cinder-volume[86219]: DEBUG oslo_service.periodic_task [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] Running periodic task VolumeManager._thread_info {{(pid=86219) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 07:06:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread count: 28 {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 07:06:27 devstack cinder-volume[86219]: DEBUG cinder.volume.manager [None req-81ad1856-0e83-42c5-af09-c9a81b63c98e None None] thread info: [<_MainThread(MainThread, started 130047720931456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86219) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 07:06:28 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=102,cinder:DELETE=8 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 07:06:28 devstack cinder-volume[86219]: DEBUG dbcounter [-] [86219] Writing DB stats cinder:SELECT=81,cinder:INSERT=32,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=86219) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}